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PE^CE 

This Occasicml Papffi^ the swoith m oiff series, is presmted with 
a mixbjce of ptide and saiiass. It constitotes one of Professor Robert 
Berdahl's last direct llnka mth tiie tep^^toKit of Hi^^ Education \Mdi 
he has chmred for the past decade, a© pap^ reflects one of Robact 
B^dahl's raajor totellectual mt^ests in recentyears--the problens md 
jK)sslbiliries of statewide CTOrdtoatlon in .ta^ican hl^^ eckcatim. He 
has a x^ell-desKrved national reputatlm m tiiis field md tea plOTe^ed 
the malysls of tiie role of state govormmts in h^ier education. This 
papOT reviews the llinited llt^afa^e tow avmllable eroJ^uatlng the perf orniaice 
of statewide boards. We axe sure tiiat ttds discussion mil stmilate 
furtho: thotj^t and malysis on m. iiiportmt topic. Wltimit my question, 
the role of statewide coordlMttog bodies have, for betta: or wrse, 
QitarOTch^d tha^elws in the biDreaiJcratic and j^litlcal reality of Amerlcai 
hl^er education. 

Professor RobCTt B^dahl tates a f^ofessorshlp in M^er education 
at the Uhdversity of >toyiand m College Park, He mil also be dLrector 
of a research institate on govmramit md hlghOT ecteation tiiere. Robert 
B^dahl's association tiie State ttdi/iffislty of Nw York at Bi^falo goes 
back almost to the inception of the D^fflrtmmt of Hi^» EA^tlon and tiie 
Departmmt is, m mfflij; rays, a result of his Itod^ship as ^^mm. 
Elizabetti Itmch is on die staff of &e Alabma ConmisslOTi on HigiOT Education 
in MmtgOTery. This paper results ftom m evaluation of the statwide board 
In AlabOTa. 

Philip G. Altbach 
E. D. Duryea 

Editors, OccaslOTial Paper S^ies 
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SECnai I: EOTDDUCrim 

A. Emluatlon as a Fom of Acadmlc Accoimtablllty 

Evaluation Is notMng new in Acadens. As early as tiie seventeentii ceitury a 
few goverirants in the colonies and lat^ In the states ecmiuied the colleges 
that they were aiding; although this process torolved ewluation, It vms not the 
rigorous op^ation t±iat vre call by that nam today. ■ (Hmrcleroad, 1980) ttor 
traditionally, studaits have almys been on the recelviiig and of grades; faculty 
have regularly beai appraised for appointmQit , procrotion md tsn^e; and smce 
the twaitieth cmtioy, nest imlversities and colleges have mdergone institutional 
evaluations by regional accredJ,tlng associations ard program ewluatlons by 
professional acerediting agencies. In rost of these later cases, however, it has 
beoi a inatter of acadanics judging academic Ic lues . 

T ntely, current a^lications of the (waluativE process have penetrated yet 
odier laysrs of the acaderoc systan. Mot only Acadane but the mtire adtmnlstrative 
strt'^ture of the educatir .il c :m±ty is now stiject to evaluation processes 
which often tacliide a heavy cOTponait of non-acadanic participation. It is no 
longer unccniiion for institutional governing boards to lamch formal tovims of 
cmpm presidents prior to renewal of appolntoiait ; md state agaicles charged 
mch the plaru ' and coordination of piilic post- secondary Institutions are now 
scrutinized by the elected acecutlve md legislative branches of state govemnent. 

James L. Mller has stated (1975) that the recmt uiterest m the s\»luation 
of state high» eAicatlon agencies is a natiffal outcane of the developirait of 
highffi- education in planning and coordJmtion. He claims that tiiese agencies 
have been active long enni':-h to Insure their surviTOl m one fom or anottier 
and the debate over #iether or not to have coordination "is past. Therefore, tiieir 
continued Ciistaice has created an ecpectatlon mmg critics and firiends alike to 
require that they eJ.ther Identify their acconijlishments or show reasons for a 
failure to do so. 



Statewide boards of eAication ^va never hmm a particiJ^ly popular 

social phenaiaiori. Poised delicately bett^men toe imiversities md colleges 

madimin mtanmy on tlie one ^d and the vMious agmciee md offices 
of state gOTerramt ^roitlng mffidjpMa accomtability on tiie otiier, mmy stat^de 
boards suffer frcm role con&m±m resulting in hea\^ criticism feom one or 
die oi±er of the '-two 8ides''"-and sc^tiros &ot both! A British mtloml 
coimte:^rt to these statero-de boards, tiie thiv^sity Grmts COTiittee, reports 
ttiat it learned to opiate on the principle of -'e^l md opposite mpopulsrityj' 
Not sm:prlstagly then, tiiere has bem much tlnkertog mtli state structOTes of 
higher eiteation In efforts to cone vp mdi '"better systenis/' 

B . Chnnr- - ^ St ractures of the State Hitler Education Agencies 

Statsd.de boards of hi^^ education appeared on liie seme in sane 25 states: 
over the l^t quarter of a cmtury mid have steadily mcreased the ffitent of 
their oversight of the institutions Ottllard, 1976) . Five basic ^es are 
idmtifiable accordtog to aelr varying degrees of regulatory authority, and 
states hmm traditionally been placed In me of tiie following categories x*dch 
correspond to Ae structtK^e of roordtaatlon: no coordinatmg structure, volmtary 
association, ad\dso^ coordmattag agency, rej-jlatory coordlnattag agmqr, and 
consolidated govmrnig bo^d. (A deflnitlOT of diese ^rarious board ^es may be 
fomd in Appaidlx A,) It is not mthm tiie scope of this presmtatlon to 
provide a croprebmsive analysis of these various types of boar^; rather to 
attenpt to shm m Ihe follorar^ table ^e rapidity ^lith ^Mch chmges have takm 
place anmg tiie states tiie past forty ye^s relative to tiie type of 
statetdLde stracojore mibraced. (For a ccmprehmsive malysis of 
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bo^d stn^ti^e sea GlOTiy, 1959; ^^hl, 1971; ^rnegie C^aplssim, 1971; 
miard, 1976.) 



Table 1. Ntic^^ of States Classified by of Staterf.de Stoictmre^ for 
CcOTdlnatlon in HJgh^ EAicaticTi, for Selected Ye^s, 1940-1979 



of Coordinating 
StructiBre 


1940 


1930 


1960 


1965 


1970 


197' 


No toard 


33 


28 


17 


7 


2 


2 


Vbluntury association 


0 


. 3 


6 


3 


2 


0 


Advisory coordinating agaicy 


1 


1 


5 


11 


13 


10 


Rfigulatory coordinating agaicy 


1 


2 


6 


12 


14 


18 


Consolidated governing board 


13 


14 


16 


17 


19 


20 




48 


48 


50 


50 


50 


50 



* State 1202 Coffmissiomi treated lat^. 

Table 1 indicates tiiat thace has ob^ously bem a trmd amy frcm havtag no 
'^o^d or ha^^^ a volimtary association to Bom form of foOTal coordtoation. Even 
mthin tiie v^ious categories of forml coordtoation has beai cmsiderable 

TOVOTQit md evm mOTe considffl^atiOTi of finrthKr changes. Li the past decade j state 
legislators In Ut^, Wisconsmj and North Carolina all atolished tiieix coordinating 
boards aid created consolidated govemu^ boards; California md COTnectlcut 
temimated eels ting coordlr^ting structi^es and established nm ones m titisix 
place; Icmsima, Whssachusetts, Itonesota, tttssoiffi md Em York reacted ^^iously 
to proposals for restmitiffu^ the pl^ijjig md coordinaticri of higb£r education in 
those states; md Florida, M^Bsissippi mnd West Virginia 'ha\^ auttorized m ^tmial 
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cmsultlng fim to ^mluare elai«its of their higher ^icaticm systean. South 
Cff.olina's Legislative Aodit Couoticil mdectOTk m mt&cmive mralmtim of 
Com±Bs±m on IlLgher Edmation, #iich resid^t^d m a steaigtham^ of the 
Ccniiilssion, and the Alabam Ccmd.ssion on Higher EAicatim has just hem evaluated 
for the secorid t^ In accord its ^^ling legislatim. (km thing is clear, 
mmy judgMits are betag passed on the relative n^its of the v^ioiis forms of 
coordmation aid gova^mce, 

C* Pmrpoeeg of the Paper 

Thm developimt of this pap^ tos the result of die authors ' participatim 
to the evaluatiOTi of one ^ich ag^cy~tiie Alabma COTmssim m ffi^ar Mucation. 
As mil be ^lain^ later, horever, the focus is less oa the Alabgna evaluation 
and nore on the elaborate evaluation criteria ^am vp by the SouA torolina 
Legislative Audit Comcil to use to assessing tiiat state's COTidssiOTi m Hi^ier 
Education, 

Ihe plm of the pap^ is as follow : Section II xdll elaborate on tiie 
reasms #iy bett^ evaluation of stat^de bomds will be In^rtant to a wide 
tsr^e of conbrltuaicles, Secion III mil address various c^lecities of the 
process of waluating pitatem^de beards SectiOT W mil briery s^^^TOarize the 
imjor relev^t evaluation efforts md^takfn rccmtly, md Sections V and VI will 
preSQit the evaluation CTite-;^ used to Soutii Caroltoa, detailed critical 
reactions to than fron selected respOTdaits aro^md Ae comtry md our am 
cooraposite set of crita-ia based on these reactims. Ftoallj^ SectiOT VII shifts 
the focus frcTO one of ^Mch crit^ia to jrt^ stould evaluate- -ln m effort to 
aUOTer at the state level for issues pertaining to higher education, 
that age-old issue of "Who guards the guardians?." 
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II. mss^s mK mmm evm^atiot 

A. Ad Hoc and P^iodlc S tate Emluatigis 

As nmtloned above, tiiae tes alrea% bem a ffcmt deal of ad b^c evmlimtion 

of statewide boards of ediKation, md th^e is Bsievy l^el^ood tiiat 

this mil coitmiie. 

Over md above sudi ad hoc state actios, to soise the probability of nk^re 

regular^ed state e\^limtioM alo^ the line of the curraitly=unl^^ Al^ama 

pattern. The mabllng l^islation est^lishtag the Alabma Camlssim on Hi^er 

Education m 1969-70 mm^ted that ttm Conmission be ewluated every foiir years 
by a coramttee xMuh should Include at least tiiree persons not associated mth 
higher educatim in the state. The first tro sudi evaluatims have been G:^pleted 

aid will be discussed &r^tr velcw. 

Apart frcm these specialized evaluatioTi processes, one cm recognize that 
noOTal ©cecnitive braich operations m rony states hme Icng iiiclxaded at least 
passtog e\/alijatims of the xvorth md value of ti^se state acti^rt-ties ^^Mch cocre 
mder scrutiny. Ihe rore recent ttieory of perfommce budgeting crils for develop- 
wmt todicators uf agmcy outccTOs, mtfb soro momt of financial rewards 
patterned accordtagly. To 01^ teov^l^e no state has yet established pCTfcOTimce 
criteria for purposes of bu^ettog the costs of statwide boards. 

Another aspect of executive brmch eTOluations Ims been the post-audit of 
agmcy operations. Historically tMs amiit tos u^iually ranched xd,fh legality 
md propriety of expaidito-es and mtii agency efflcimcy. More recmtly, how^^er, 
the post-audit functijsns has blossomsd toto a more ca^r^imsive assessmait of 
agmcy effectivmess and has besi moved In ovot half ths states to the legislative 
brfflidi ^ore, as the Legislative Pro^m Evalmtim (WE) xvovmmt, it hlpes to 
ensure executive brmch accajntability. 
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B. The State IJE tfevm^nt and Sutigmt Legislation 

ThB Legislative Perfonnance Evaluation (IJE) raovemait represaits an effort 
by state l^lslatures to go beyond titm traditiCTial post-audit of acecutlve brandi 
fiscal managaitent to Include m assessn^it of the effectl^iess of the perfornBnce 
of tiie imit(a) selected for scrutiny. In several states tiie WE Agmcies have 
ataimned university or comitLmity college opOTations (Berdahl, 1977) and m 
CoimMtlcut aid Soutii C^ollna tJiere wa-e LPE evaluations of tiie statero-de board 
of higher educatlm. 

SaiK&ATat related to this practl,ce has beai tiie evaluation aspects of state 
sunsait legislation. Accordliig to the t^ns of this kind of legislaticni, first 
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pass^ by Colorado m 1976 md followed in anm form or matimx by at least aw^i^ 
34 states in tiie foilomiig four years, tmgeted state agmcles are to be teminatad 
by a tmB cactaln if ryot espllcitly rmewed follomng evalmtiai of their 
p^formmce. VMle few of the ^dating laws m^e conprAeislve in calling for 
suriset evaluations of all state agaicies (and fe^ states co^d actually deliv^ 
sophisticated eyaluatlons on such a massive scale) ^ tiiere ffie slpis that higher 
edjcation agencies mil soook^ ot later jota the c^^i^a In at least sane states. 
In Iowa only a tovemor's veto blocked a sunset law ^Aiich md tte lam Bo^d of 
Regerits scheduled for evalimtion mthto tiie flxst five yeari aft^ passage. 

tosofar as or simset eroluatlons iifly be dtoected at statewide bo^ds m 
titim futile j lnprwemaits In oiff imderstOTidlng of appropriate crit^ia should be 
welcoTO. 

C. Possible Federal Goi;mmimt Interest 

Glviai the Federal Govmmsit'a recait concern for p^formance eval.imtiOTia of 
federally-fiinded activities, it is not Ir^sslble to liMgme m effort to 
evaluate the effectiveness of lim federally-si&sidiEed State 1202 Commissions , 
^^ch In 12 states are the statemde boards wearij^ different tmts and in scro 
14 oth^ states are the statewide boards auginmted in ^Mibershlp to satisfy the 
1202 requirements. Haice, there is a potmtial Federal int^est u^rovlng 
the process of evaluating statemde boards of hi^er educatian. 

D, Regional Accreditation md ^aluatlm Criteria 

Regional accreditir^ associations are also probable users of such evalimtlons. 
Mtiiough the traditlOTial TOdel of regional accrediting has called for the walmtlon 
of an instimtion's ability to achieve its own chosen goals, ^re has bem 
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Increaslng awarmess of late timt a laiivKsity or college's position In a larger 
coordinating or govermi^ staictiffe can do mch to aicotirage or diMblt its 
ability to acMwe its goals. Thus, tiie bettCT regiOTal accrediting teams have 
■bagim to pay sane attmtlm to tiie dep^ee of act^nal conttols eKorcised on a 
canipus. While this broader perspective is wjcti to be applauded, it is mt mthout 
scnie dangers unless treated mft a measme of smsltivity. For Qcmple, in a 
stoidy urid^takan by one of titim presmt wit^s sore years ago, it wlb discovered 
that a regional accr^ittag tean %rt,sited m institution ^ose presidmt had 
earlier bem a collea^e of ttie cimxrma of tihe temi. Nothmg necessarily TOong 
ttere, but as it turned out, tiie t^n ras treated to a Imgtiiy set of cmplamts 
about thm stultifying effects of overcaiteallzatlon by the statwdde board. 
Mtiiough the accrediting tem ms^&rB did pay a brief call on title head of tiie 
coordinattag board on their my out of tte state, no "statenait of diarges" tos 
presQited for possible rebuttal--eitiier m advmce of that reeting or prior to 
tiie printing of the final report. Mien the cortfidmtail f^l report tos suteLtted 
to the institution, it ms ^te critical of ^e state coordinating hoard and not 
too uneKpectedly tiie criticisms TOre leaked to the press to bolat^ tiie 
tostlmtion-s fight for more autononiy (Beritohl, 1971, p. 236). Since fee 
dlnmsion of ectemal ccotrols is a very legitimate aspect of institutional 
evaluation, aiere is nothing wong in principle wi^ regional accrediting t^ns 
giving It careful consideratwn, . Judp«its about '*«cesBive centralization," 
homyj&r, do not spring Mil-blow, from the ether; &ey must be culled frm a 
fair deliberative process ^ich inco^orates widespread consultations and xAil^ 
results in ^licit guldeltoes. Th^eln lies the relevmce to regicmal 
accrediting a^.^^ntations of efforts to taprove oi^ toowledge of ^t constltiites 
"good" statOTide coordinating md plOTLntag, 

Er|c ■ 16 
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E. Other Potmtlal Uses 

To COTplete thm Inveitory of potaitlal uses of evaluations of statera.de 
boards, we need to cite a Camegie CmnrLssion reCOTnEndation (evm. tio^ it has 
never been Inplffiaited) 

tiiat a sp-acial ccnmission m InstitutiOTal independaice be established 
mthm the Aterlcm Council on Education; tiiia caiinission, whidi should 
consist of both ACE manb^s and pi^lic would be assimed 

respOTisibility far revlffljing actemal Int^ference mth tostitutioridl 
andepaidmce md issuing findings after audi revirara. (1971, p. 107). 

As TOs the case with regional accrediting temi Jud^iaits about "excessive 

cfflitralization," such Affi comission Judpimts about external interfermces wDuld 

need to be based on v^ careful distinctions between those ©eternal 

controls legitimate and necessary aid tiiose ^Mch are not. It is perhaps 

because of the complicity of arriving at any broad agremmt on tiiese mattes (as 

well as the aiijarrassing prospect of m ACE conmssion attaiptli^ to caisure a 

state systOT guilty of accessive int^fermce with Institutional Independence) 

that the Camegie CannisslQn recOTmmdation.hf a not bem Jnplaiaited. HowevOT, 

Eog^ Heyns, Presidmt of the Aa^ican Comcil cm Education In 1976, did said out 

a letter on January 6th of diat year amomclng tiiat if there ras sufficiait 

response his organization wuld be willli^ to establish paiels of qualified 

persons who W3uld then be available to visit a state v^ere relations betweai a 

cmtral board and Institutions had become badly steained. Ttm Invited observers 

would thai do their best to restore die necessary working relatiwiships . Ihe 

project was quietly dropped, however, whai oth^ associations responded widi 

neither interest nor fimds. Nevertheless, the idea of developing sore Institutional 

comterpart to the Americoi Association of University Profassor's Conmittee A to 

monitor statewide systans is one idiich, in seme modified form, niay someday be 

inplanaited; md at such ture, evaluation criteria will obviously be needed. 
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III, ^OTira^s MD ccMPiEa'TiES m mmmmG BTmmmE mpms 



A. P^sonallties May Be More Sr^rtmt ^toi Structig'eg 

To keep tttogs perspective ^ am should a^nc^ledge Aat the success or 

failiffe of state boards may noonally be more dep©itont on the role of persOTalitles 

than on tlie liiaue of steucture ot powers, Samiei Goiid haa said it toII* 

The raore subtle persorml contacts , . , are the mocp md TOof of the 
fabric of (the) relationship (betroCTi the state and tniv^sity) ; . . . 
(such contacts) defy rules md deftoitions mi foimilas. . . .^ey are 
the true toeans by x^^ich tiie delicate balmce of authority, respOTisibility, 
and Interdependmce ©cisting beto^m title imiwrsity md st^te govemmmt 
is TOiitaiiied, or, TOtt^s go awy, is ^^set. They r^resmt die 
int^play of personalities, tiie devel^imt of attitudes m the part of 
these personalities reflecting a clew und^standing of respective roles 
md niDtivaticTis , and most of all tlie cr^tion of a clliimte of nutual 
ttust md respect. (1966, p. 4). 

It is also true, horov^, tiiat ticm ''availability of practical macUnery^' can 
help u]^rove the ■'climate of opimon" wititiin ^^ch the key persmalities 
interact (Qiarsm, 1956, p. 321). ^s, without exaggerating die M^rtmce of 
board structure, it is still TOrtoMle to eramie criteria by ^*iich the straigths 
md wedtaesses of various bomd pattens are assessed. 



B. C lassifying Structures by FOTnial Atfacibutes Ifey Be Msleadl n^ 

Another caution is needed. Not only are parsmalities oftam roore Ij^ortait 
than structure, but structure itself may be deeply affected by the play of wmy 
oth^ elaiKits- 

Seme agmcles have inore power tJim thel^ mablwg legislation 
si^eats because tiay sacm hm^ on lirformal poorer, Infli^mce, md 
"credibility" with state officials md ttie pi&lic* O^&o agmcies 
have less pCTOr titmi tiieir statutes sv^jest because theto credibility 
is low and their recomaidatloTis are igiored. Ttm TCb of Informal 
relationships, COTmunicatlori, md reject ancng legislators md tiie 
state agmcy is ^tramaly InpOTtmt md is oftm overlooked Ofl-Her, 



1970, p. 49; 
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"Rius, me deals with categories such as ad^^sory and re^lato^ 

coordiriatuig bomds md consolidated go^mn^ bomds, me nust raiad)^ that ui 
practice tte IJjies blur betwem differmt types. Tn a si^vey of the three tnajor 
types of toards to nme other states, a Task Force of tiie iMvttsity of MssOTjri 
(1972) , had been established to recmnaid a pattern of statewide coordimtion 

md governaicej found that In tteee crucial ^eas,long-rmge plaml^, resource 
allocation md use, and progrm control, '*board types" tos less influmtial as 
an ©q)lanatory variable 'IbauHn, econOTd-c, md political modifies" (p. 49) . 

The task of classi^dng statOTide boards has hmm further coiplicated stace 
1974 by ttie designation in most states of statewide post-secmda^ plmning 
cQrodssions responding to Section 1202 of the Hi^«^ Education toendments of 1972 
md fiffided modestly mth fecteral fmds from Sectico 1203, In sane states 
existing statemde boards have bem desi^iated as the 1202 Coimri-ssion; In others^ . 
the bo^ds have beai augimted in niarbership to serve tins fmction* and in still 
othffis, OTtirely separate commissions have hem established. There is, therefore, 
question about the proper classification of a state mth a 1202 cormiission as 
mil as a statewide board, or one mtii a 1202 commission i^ere there previously 
liad bem no board. For our evaluation pittposes, to are ignoring tiie separate 
1202 cmmlssions since they are fm and of recmt origm, 

C. Little GrLdance frqn the E^ly Ldteratu^e 

to a TOrk reviewing the e^ly literatwe (BerdAl, 1971, Chapter 3), problem 
of ewluating statewide boards of hi^er education were dismssed md it ws 
noted ^ "One searches the relevant literati:ffe Jji vain for objective canons of 
proof #ilch would rffliove the subject trcm controversy, hixt one fmds only 
unsiistmtiated and contradictory argiinmts as to xrtiy coordi.iation is 'go^' or 
'bad,'' or \diy this type is preferable to that." 
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M. Chmbers' ccnnmts illustxate tiiis dilCTm- 

Soutii Dakota atolished Institutional go^mmig boards and set up 
one toard in 1896 tciiidi tow governs sevai instl&itions, Tte^e hsm 
bem B±Kty-fmr yeaoos of ©qp^imce td.tii this device, cm pcove, 

md by^^t tectaiq^s, timt Souai Data's institutions of 
, edication are today my bett^ (or my TOrse) , ot ttet ttie statera.de 
systOT is my bett^ or wrse, tlim it wuld teve bem if separate 
govemJng boards tad bam continued, mth opm rivalry, or mth 
volmtary coardinaticti, or with a COTpuLsory coordinatins aamcv? 
(1961, p. 58). - y 

^feyhew (1969, p. 32) also tnmtims tMs gap in the lit^atoe: "There have 
bam no studies to Indicate tot elaborate coordinatlOTi does or does not affect 
levels of state expmditoe for highCT educatiOTi, percmtage of a pDpulaticm 
attenduig college, cost of tostniatt^i^ ot maeased pr^iwti^ Lty of high^ 
©Jucation.'' Ihat saM year a stirfy appeared in Colorado witii tiie flndli^ that 
"the overall ratio of allocation to re^st, ye^ by year, md Institution by 
InstitoitliTO, has not tocreased as a result of tiie chmge to tl^ £coordtoatlngj 
CkimiiBSiOT" (Brooks I 1969), 

The Uhlverslty of ,Mssomi Task Force stady cited above Jncluded an appmdte 
discussing the problans of teylng to establish relationships betwem a particular 
type of statewide board md v^iam fiscal measles. The me finding reported 
ms that "these data do not suggest the ©dstmce of a very sttmg relatimshlp 
betwem types of coordtoating sttucture md die rate of chmge m the mount of 
&nds appropriated for hi^^ educatim for the paiod stace 1960" (1972, p, 62). 

Nor were my new luto established by a more recmt s&jdy conducted by Hmry 
Rrost for tiie Ctonegie Fomdatim for ttim Advmcmeit of Tea^ng (1976) , ustog 
nultiple correlatim malysis betwem the differmt ^as of statem.de agmcies 
ard selected Midicatora of state p^foraancej eu^ as access, fmdlng md diversity, 

f^oblans mth Goals-Orlmted Evaluatim It^ory 




Acccardu^ to tectbook evaluatim theo^, assesanents of statewide boards 
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shoTJid cocmmce mtii an exandmtiOTi of state goals md problaris, proceed to a 
deta^dnation of board fimctians necessa^ to achieve tiiose goals and ov^c^^ 
those ^oblana^ md thm mwe to an analysis of tihe board strtictiares ^^ch cmild 
best mdert^^ those fimctions. Only thai TOuld it be possible to arrive at m 
understanding of the kmd of leadership ^Mdi rauld TOrk tteough tirose structUK^es 
and fimctiona to the acMeva«it of the deseed goals. 

In practice, however, such a goals -or iaited evaliiatiOTi process my nm Into 
my of several problaiis. For ^carple, the state's list of goals may Inadequately 
respOTd to smious existteg problens or fail to mticipate ttose ^ch are orerging. 
So che evaluation process stould appraise not OTily the achievmmt of goals , but 
also the ade^cy of ttm goals theiaelves. Yet h^m we confront the issue of 
siijectivity of values in choos^ goai^. One pecson'SiOne agmcy's, roe state's 
choices raay not be those of otiiecs, md it is not possible by mere malysis to 
''prove" #iich set of goals is the nost satisfactory. 

Astto (1974) potats out tiie difference betrom conc^tual outcmes, ^ich are 
basically derived £rom values; and outcome measmes, ^Aiich cm be scioitifically 
derived to assess the aohiwarmt of the conceptual outcomes. Ihus, one cm 
evolve objective mems for measurtog the ^tmt to vMch certaJn desired mds 
have been achieved to a givm (statewide) context, but one camot thereby prove 
that those mds are to be desired by all above others. 

Qrie partial answer to the problon of subjectivity to decidii:^ values, ends, 
goals, md objectives night be fomid to the emrgmcm of a form of national or 
state consmsus. Tro hi^ily Adsible cramissions issued reports to 1973 tduch 
suggested goals for highm education aroimd vAd.±i such consmsus might fflterge. 
(See ^pendix B for the tonegie COTmission (1973) list of pv^ses^ of higher 
education to the toited States and ^e objectives of the NatiOTial Cotnmissim m 
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the Fl^mclng of Post-secondary Education (1973) , ) 

To tiie eKtmt that m Idmtlfiabls raticnal consQisus mght mmrge aromd 
goals foan studies such as ^ese. It tnight be possible to deTClop approp^iata 
outcore meastres (In Astm's t^^) md evalmte statewide boards by the degree 
to #iich they had helped to achieve such goals. (The NatiOTil Camlssim in fact 
si^ests raeama^es for each of its objectives.) 

In tiia evQit timt national consmsus my not prove feasible, a state-level 
consmsus p^haps be more realistic, Tn California, fw ^ wpLe, the Jotot 
Legislative COTmlttef* the Jfast^^ Plm cOTniaslcTied a sfa^y (Petarsm, 1973) 
^Mch exOTdned a^emmt md disa^eanent mang a broad gco^ of acadffliic and lay 
people of 20 ^eas selected Crm the fiistltoitlmal Goals Mvmtoiy of the 
EducatlOTial Testtag S^vlce, Suialmly, to CklahCTa the Board of ItegOTts 
coKiicted a statewide goals study (1976) and Involved ot^ 3,000 lay citlzms. 
Presimably, if a strong state consmsus merged, the goals to cp^stim could be 
used as a legit Jiiiated set of objectives agatost t*ich to assess statewide toard 
acMevOTaits. 

Sevexal problfflis rffliato, hcfwev^, to the first place, . '^le widespread 
agreaimt might be obtatoed m goieral goals, disa^eerMnt oftoi ^rges vAim ^ 
goals becane tUDre specific, Fiff AraaDre, mm mth tiie specific National 
COTnission outcone measles, honorable peqsle quarrel ov^ the ecact nemtog of 
t^ms like excellmce ,- sufficimt . and responsive , to additira, it is rat unusual 
for sore gaieral goals, e.g., tostltutional freedom and fledbillty, to have a 
potential conflict ot±OTs, e.g, , tostltutimal accomtabllityi md to most 
cases, no priorities are established to guide evaluators as to ^ch goals have 
precedmce. Th±B lack of goal priorities could be ovCTCOTe by asktog the political 
process to hmmer out acplicltly ^ich goals head the list and x*iich fall to the 
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bocton, but Wlldavsl^- (1964) pointed out long ago how distaste&l It is for nost 
politicians to be asked to Bnate choices anong macro-policy altematlves as 
opposed to their prefermce for trading off itans at the nmgm. 

It may be rare, thai, to have state goals for hi^er education TTt-edanted in 
a form that is cmprdimsive, specific and prioritized. But mm if this ocdtt-s, 
there will still ranain the cmplex. problan In social selaice analysis of assigiiiig 
credit and/or blane to the statewide board for tiie achievanmt or nari-achievmarit 
of these goals. Sievitably there are so many other mt^vailiig -rariables betweai 
the actions of the statewide board and the alleged results it nmy be seeking, 
that while me may attribute certain cause-md-effect relatiOTiships to the 
process, there xd.ll usually be little certainty to such Judpmts. We are tiws 
quite far Scam having a satisfactory goals -oriented evaluation process for 
statewide boards. 

To Illustrate the difficulty of ti^dag to evaluate perfomance on the basis 
of goals and results rather than process , we cite in ^pmdix C two major 
evaluation efforts In elanmtary/secaidary education md ±n state legislative 
processes #iich, notmthstanding very substantial fimding, staffing and time, 
were unable to go beyond evaluation of process . Based on these efforts we 
should not, then, too easily asstme that a satisfautory evaluMtion of 

statewide boards would result if only substmtiai time, talait, md resources 
could be mobilized. Nevertheless, we do wge a continuing doi:tole attack on tiie 
problan by working at both the coi,-,ceptual sa)d the practical levels. Tha literature 
on educational evaluation, \Mlm still orlaited prlm^ily to instructional matters, 
shows pranise of developnent . For exoiple, the Bicyclopedia of Education.a l 
Eh^luation (Mdecson md others, 1975) offers a cjnprehaisive overview of the 
topic. (The following headings ai-e relevant to this work: "the politics of 
evaluation," "hard and soft evaluation," and "the evaluator's role.") At a 



more mtaise, nbs tract level, Evaluation and the Exerolse of ^thorlty (Dombusch 
md Scott, 1975) may stlmilate parsons professionally equipped to profit from it. 
Perhaps as a good cKma, Patjl Dressel's 1976 Haidbook of Acadanlc Evaluation does 
include a chapter on "State Coordination and Planning." While the various criteria 
si^ested (pp. A43-449) cover the Tnost loportmt dimensions of board fimctlons, tiiere 
are unfortunately faj guidelines offered on how to datonstrate die crucial llrfcage 
bete^eai board activities as "cause" and varioija "good" and "bad" developments as 
alleged "effects." Nor, for timt matter, is tiiere a normative philosophical frare- - 
work to justify the faTOrable and unfairorable judgmaits. Also helpfijl is a TOlune 
edited by Bowm (1974) containing several excellait articles Brom's piece, "Taking 
Advantage of External Evaluation," .a particularly relevant to our central concern her 

IV. MOTT EVALUATION EFFOKS 

In keeping wltii the above-maitioned need for approadung tlie problan of 
e\mluating state&dde boards on botii the theoretical tiie practical levels, we 
cite now brief sunmaries of recait efforts to assess such boards In c^taln states, 
reserving to Section V special treatment for the most e].aborate evaluaticn m South 
Carolina. 

A. Self -Evaluation Kits facm^e Association of Governing Board s (A&B) 

Althou^i It does not constitute a fomal eTOluatlon imtotaken by sOTie agaicy 
ectemal to the statewide bomd, we commmce wltii the AGB self -evaluation process 
as an esaiple of the midlest form of assessment. 

Ihe AGB has a #iole series of buch surveys , with tro of than specifically 
designed for stateid.de coordinating and governing boards respectively. Itille 
undoubtedly useful as a starting point in mderstanding a board's self-image, these ■ 
surveys suffer from major weataiesses i nost of the survey questions seen to elicit • 
more of a yes/no flash picture vla^ of the board operations than a nuanced assess- 
nent of bo^d performance ava any period of tijiie. 



The s\jffvey for coordlnatuig boards has questions divided into 12 topics^ 
and Topic 9 - Statewide Educatioral Plmning— Policies md PrMeAffes- -probably 
cOTes the closest to a broad assassnait. (See ^pmdijc D.) T^e traatomt of 
goals lists 12 possible goiaal goals md asks the respondmts to rate thm 
as of hi^, mediim, Im or no iirportance. No probtog^ howev^, is mdertdcen 
cn the extmt to ^iAd.dk, if my, the statewide board has a responsibility for 
attaining the cherished goals, or oa the de^ee.to xMch tiie bo^d has achieved 
those goals for #iich it is deored to have scene nmjor resiraisibility, 

A letter fron tiie Affl m 1979 todicated that three cmsolidated g^^mtag 
boards had eriployed the self -evaluation kits, but tiiat in some states so-called 
"simshtoe lam/' reqmring all ncn-^ecutive session delibOTations of public 
agaicies to be cOTiducted in tte opm, had acted to Irtiiblt bMrds from ^igagtag 
in evaluations iMch would probably produce critical md/or divisive information. 

Uilv^slty of Missouri Task Force m State Level Coordination and 
Gwemance m Highkc Education 

to respOTse to a state 'little itoover Commlssim " recOTnmdation md 
subsequmt proposed state hill polntmg to a substantial centralizatim of 
decision-m^ing in M^r education, ttie Rresid^t cf the Uii^^sity of Mssot^ffi 
established a seven person Task Force to investigate patterns of coordination md 
governance around the country md make recOTimdations for the W^ssaxci seme. 
This Task Force issued its Report (1972) and, on &e basis of its deliberatims , 
recorm»ided a mlder f^»m of regulatory coordinating board, aubstaice of 

those recOTnmdations need not concern us, but the process by #iich the Task 
Force arrived at its conclusiOTis is of great mterest. 

The Task Force established a set of 13 process criteria (see ^poidix E) md 
then, for each such criterion, on the basis of orgmization theory, postulated 
board p^forrmices ejected according to board type: advisory coordinating, 



regulatory coorc^aclng, or COTSolidated governi:ig. The irmb^s of the Mssomri 
Task Force tiim visited nine states cov&cing all tteee tj^es of boards and 
cot^ared actml bo^d pa^formmices (based on Interviews within the state) mth 
tile theoretical postulates, ^e resulta^ ca^aratlve mraluatlons ^xm shorn m 
i^pmdix F, 

Mtiiough the nine state case studies were thin (tovol^dng m mdividjal 
Investigator mtometmig 6 to 15 persOTis in a state in tro or three days) , the 
Task Force haidllng of their postiaates was fairly professional, niey recogrdz^ 
that #iile the 13 criteria wei-e "consid^ed to be reasOTable," they TOuld 
'*not necessarily (be) of equal iirportmce" md that *^a read^ of tills report may 
be ejected to focus his attrition on a llmted set of criteria md to reject 
oth^s as trivial or, at best, secondaj^ in overall tepOTtmce" (p. 8). 

C, Alabama ^/aluations #1 and #2 

The 1969 mabllng legislation establlshtog tte Alabaoma Camdssioi on Hl^er 
Eduction included mtihto it a pro^^sion that every four years a camiittee of 
at least tiruree consultants not associated witii Mgher education m the state 
evaluate the effectlvmess of the ConmisslOT and recamaid changes as needed, 
^e ftest such cOTmlttee tos appointed by the Ccnmisslon in 1974 md consisted 
of tteee out-of-state professlOTals m hi^er echjcatim plus foiff Alabamims ^o 
had no associations with hi^r educatim in the state. Naninations for 
appolntiiients to the conmttee cane frcm various sources, Including the post- 
secondary institutions. The report, published in 1975, recoimKided streigthmlng 
the advisory coordtoatliig board and givliig it regulatory powers over approval of 
proposed new acadanlc programs. Ihe Ccramittee arrived at its Judgnaits after 
soliciting wltten aid/or oral testimony ft-cm a wide varied of persons in the 
educational and political worlds, but had neither the staff, ttie tiro' nor the 
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budget to try to develop a formal set of evaliiatlon criteria. 

Altiioi^h the Sffiate of the Alabana legislatmre in 1975 s\isequaitly pasied 
a bill aiixDdyuig nmy of the evaluation ccmnittee'a recannendations this house 
was presided over by a Lieutenmt Governor v^ hDstile to ^e COTinisslon. 
Iftider his leadership a confereice comiittee succeeded in cutting tiie Camiission's 
operating budget fran $300,000 to $200,000. In 1976 md 1977 legislation to 
strmgtiien the Ccnmiasion was passed In ttie House but failed to gain acceptance 
in tiie i^per diamber. 

Ihus, the Ctoranittee's principal value lay less in my liiniediate political 
tapact or in tiie formation of acplicit criteria for eTOluation, md rmre in 
establishing the precedent of the first mandated, periodic state board evaluation 
aid in deraDnstrating the value of a mixed in-state and out-of-state maribership. 

The caiposltion of the seccnd Evaluation Conmittee differed sli^tly from 
the first. The first Ivaluation Gnnnittee had reccramaided tihat subsequait groups 
be appointed by a diff^ent, ndxed process: foiff Alabamians were to be appointed, 
am eadi by the GoTOmor, the Lieutaiant tovemor, the Spe^r and the Mabana 
Cannission on Higher Education; and these foipr vmre to choose the tliree out- 
of-state professionals. But this proposal died In the Icmx home bill, and 
the second Evaluation Conmittee tos appointed in 1978 in the sate mamer as the 
first, by the Cannission. "flils tJaie, hOTrever, tiiafe were four out-of-state 
maitoers and five Alabanims. Three of the faux out-of-state UMiibers represmted 
ttie saifi constituencies as the first comnittee: a forror director of a statewide 
board, m active imiversity president and a prafessor specializing in studiei, of 
statewide coordination and goverrmce. To these was aMmd In 1978 a professor 
well taom for his studies o.f two-year post-secondaty Institutions . This lattfflc 
appointment tos Initiated presumably to reflect recognition of the 1975 re^rt 



criticism that tiie Cor.nlssiorJs relations mth ^-year insti&itions in the 
state needed to be uiproved. Also presimably the nmfcer of in-state makers 
ms mcr eased to retaui a mjority in ^t catego^. While si^h a balsmce may 
have bam in^Dortant s^toollcally In the state, in tferms of actual discussions 
md svfcsequmt recOTiraidations ^ neitli^ the first nor the second canmttees 
reported any in-Btate/out-of -state bloc divisions x^tsoever. 

Hie second cOTmittee operated almg lines similar to the fdxst: a budget of 
approKJinately $28,000 was appropriated md t^e CCTtnittee tos given abc TOntiis 
In ^diich to reports the staff was llmted to a secreta^ md the on-call 
services of the AOffi staff lOTiber desl^iated as liaison to the comidttee; 
deliberations wre conducted m private and confldmtiality was gimranteed all 
respondents and witnesses i tiiere ras m itaspectiori of all ACiffi piJDllcatlons , 
n^utes md program reviOT proceedmgs ; and attmdmce at an ACIE nieetlng 
devoted to budget hearings ras arranged, Etortag die second e^^lmticn process 
mch xwfxm attention tos devoted to tte political side, P^l use was made of 
the contacts of the five Alabma ^^ers to invite in key legislators ficom both 
houses arKi repres^tatives of the incOTmg Gov^nor's Off 1m, and In additiOT, 
persons firom ^oups such as the State Gmb^ of Cannerce md the League of 
WDmm Voters were invited to testify; md thousmds of copies of a brief Surmary 
Heport were distributed aroimd the state, at the sfflre tlire as t±e Report itself 
was issued m ^farch 1979. 

Whether as a result of diis broadmed attoiticm, the ai^lval of a new 
Governor (and Lieutenant Govemor) md or sane other factors— tills tiire a bill 
to strrngtiion the CofrniLBslon passed both Houses and wlb sipied into law by 
Govemor July 30, 1979. 
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If tlie second ccmnittee snjoyed somewimt ^eater success than the first in 
term of political lnpact,^ it was not tioticeably mxm effective In advmcli^ 
the national art of statCTide board awluation. At the outset the COT^ttee 
decided, to essaice, to attarot to look ''badcsOTds, for^ds and siderards,'' 
IMs u^at me part of die evaluation ms to look back to the powers aid 
responsbilities accorded die ^ard by its ^blit^ legislatlm, to determme 
wlieth^ these tro elsnaits w€£q cmnmsOTate, md if so, tow i^ell tiie Carmssion 
had discharged Its responsibilities Mth those pOTOrs. Another part of the 
e^faluation ws to look forv^rd to QMrgtag problens to the state to ascertato 
#iether the COTiPission, mth its current respmsibilities md authorities, 
(hoTOver toII it my have disctiarged these duties to the past) wuld be able to 
meat thbse problens, A lookii^ siderards or outo^ds was for the pmrpose of 
bringing to bear oti both of the ^ve dinmsions toe relevmt Insights gatoed 
fron ffl^a^lences md studies to otha: states, 

IMortiffiately, ttie relatively prmLtive state of the art nationally, 
combtoed with the Caiinittee's lade of staff, tlm md budget, precluded dotog 
mythtog iiiore thm profiting tofomally from the fairly ^tmsive personal 
Q^erlences of the four out-of-state nMibers, M imsiaccessful effort to 
adept SOTi criteria from South Caroltoa will be described belOT. 

D. Msslssippl. West yirgtola md Florida ---- Oo nso Xidated Gm&mlnz 
BoardT Evalwtions by tibe Acadmiy^or ^u^ tlonal D^^^^t 

Pertaps as m optutiistic mm of tim tocreastog tm^ of state board 
evaluations, airee Soiaiem states recmtly cOTprlssionKl the Acadfetry for 
Mucational Developm^it (MD) to mdertake studies vMch tocluded assessn-imts 
of the effectivOTess of the consolidated govamtog board r^ra^attog to each of 
these states. 



In a July 1979 report to die Mississippi CCTnmissioti of Bi^get and ^corniting 
mtitled C tovemance of P^llc Hl^er E ^atim m Mississippi , the AED idmtifled 
die follcfrai^ five niajor roles of a consolidated gov^ing board aid then 
evaluated the p&ciommQm of die Mississippi of ^gmts relative to each of 

these follcrong bxbbbi 1) Govemdjng BMrd of todivldiMl liistimtions , 2) 
Statewide Flaming , 3) Statemde Cbordinatlon, 4) tosulation ftcm Political 
Interfermce, md 5) R^lic Advocacy. (The five PED assipied roles and Bom 
related tasks imder each hjeadlrig are Included in ^pmdlx G, ) 

Thm found aft^ ^tmsive study of rele^;TOt docimmts and interviOTing 
of nimerous persomel that x^le the Bo^d of Itustees had dona a good job in 
secwlng political insulation of die miversities, it badly needed strQigthaitag 
In Tnost of its other roles, pmticul^ly diat of long-rmge plaim.ng. Nevertheless 
the Pm stopped stort of recOTimdlng the repJ^cenOTt of the consolidated 
governing board by a coordtaating bomd, \Meh the Am felt tni^t do a better 
plaining job if freed of goVOTimee responsibilities. 

This is ecactly tAat die MD did reCOTimd, however, in its August 1979 
report to die Joint tomittee m GoTCmimt and Flnmce md the Joint SubcotTmttee 
on Hi^er Education of the West Virginia Legislat^ei St^pmt, PerfoCTmice md 
Protection of Higher Education In West Virginia . M this report the m) assessed 
the p^t'orramce of the West Virginia's consolidated Board of Regmts alcog 
diMriSicns simLlar to those used in its Mississippi study: 

1, Managairait, Control and Si^avlsion 

2, StatOTide Activities 

3, State-level Budgeti^ 

4, StatOTide Planning 

5, Relations with State Govemnmt 

A conceptual Ecaamsotk was offered on the nature of these activities as 
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undertakai^ b/ either a consolidated gcjvermng board or a regulatory coordlimting 
board, and then ccnparisons offered of the straigths and weaknesses of eadi 

Oci the basis of this analysis, tine MD reconnmided as a first opticm the 
creatiCTi of a coordinating board to replace the consolidated governing board 
and the establisteait of tiffee sepaital governing boards to operate the 
various Institutions under the plfflmlng and coordinfltiiig urtjrella. Txi case the 
West Virginia legislatiffe felt such an optim was too radical, the MD offered 
a second set of racOTTOndations to straigthen the performance of the exiatJng 
Board of Etegaits. To the surprise of few persons, state authorities chose the 
second option. 

The Florida study tos mdertaken by tihe MD for a Joint Bceoitive LegislatiVB 
Study Coomission on Postsecondary Education ^Mxti reported In Itoch 1980. imfng 
tile questions acmdiied tos x^iether to alter the consolidated governing hosxd 
to a coordinating board mch goromlng boards created at the local or sub- 
system levels or to leave the governing board in place aid create an unbrella 
coordinating board over it to plai for the two year, four year, vocational and 
private institutims. In a preliminary DiscuasiOTi Paper #2, tiie Governance of 
State Systans of Hi ^^ Education . Jolm Millettt of tiie MD offered six "essential 
characteristics to be sought in state government organizational arrangements," 
t^ich ajre preseited in i^pmdix H. 

In its final report to the Florida Camiission, A Call to Action (1980), the 
AED discussed various structiffal options but made no firm recanimdations in 
this sphere. The Camiission Report Postsecondary Education (1980) iffged the 
untorella board option with strong enphasis on its planning responsibilities. 
Governor Grahan subsequently vetoed an cmibus bill containing nmy of the , 
Conmss ion's recortmaidatiDns because j.t also contained nutr^ous political trade-offs 
But he inoved to establish uiibrella plaiming board by SKecutive acticm. 

30 
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E, IfE ^mli^tlons In Comectlcut SouA Garoliiia 

M nrntlooed above In Section II, the Legislative P^fomiance Evaluaticri 
ncn/OTent has already ijadertakm evaluations of statewide boards of Mgher 
education m tm states. Mthoi^ both bear tiie teprM^tiff of m LPE staff 
study, the diff^aices In tiie tro reports me huge, "^e tomecticut study 
Sttmgt henmg Higher Edumtion In Comacticut (^ril 1977) gave considerable 
emdmce of having bam writtm under sev^e tue pressures, Smm of 
the origiml charge to the Legislative Program RevLew md Sivestigations 
Coomttee had to be dropped md m "Agmcy Response'^ nommlly mcludad in IPE 
reports yms otnitted. Hie study recOTrnded tixm abolition of fte ^sting 
coordinating board md Its replacanfflt by a stronger toard witt changed mfflibers 
Ihat the state govemmmt siisequmtly Inplmmted tMs reccmmdaticn does not 
alter thm weakness of the report as m evaluation doouc^t. It contained no 
explicit frmerork for evaluation of tiie stat^dde board. Distead, one reads 
of x^t appe^s to be ^ p^te Judpmts about the need for strmger caitral 
lead^ship, a stronger bo^d role in plaming, budgeting md pmgcm remew 
and a better inmagoitent inforaation sendee, ^ese judgp^ts may or nay not 
be correct; the point is tiiat the dociai^t does not comect then to a l^ger 
framerork of evaluatibn xd^^^ is itself smsitive to the mny numces md 
dilffltnas abounding m this field, 

Th contrast to this , the South Carolina process tos mudi more elaborate 
both In devising a conc^tual frarerork and in the lQig^.s to x^ch the staff 
wait In ord^ to acquire relemit evld^ce, Ihe mln flaw, to o\x eyes, lay m 
the Legislative AiMit Comcil*s(l^) Insistence timt its chacge did not include 
appraisal of the coordinating hosacd's positive accc^lislmints, M evaluaticn, 
by 01^ logic, must Include reco^itim of the good as well as the bad. 
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Nevar^eless, the crit^la created by tim staff were of sufficieit Interest 
Aat #ign tile seccod Mabma evaliJatlon shprtly thereafter took place (as 
described above) , copies of tte Soufli tecollna CTlteria ^re mlled out to socm 
70 respondmts aromd tiie coimtry, requesttog tiieir critical reactions on the 
ectOTt to \A)±ch such criteria co^d be applied m Mab^ or otha^ states. 

Section V to presait those South terolma criteria mdthe reactiOTis to 
than frcm the 40 personfii vAn resporded. 



V, WE soum cmpumk mmjmim mmaA i a critics amlysis 

A. JAC Creation of lAa Criteria 

ai 1977 title legislative Audit Comcil (LAC) in Soutii Cacolliia asked to 
evaluate the CotMssIco on mgh&c Educatim (affi). ^e s\±>sequmt report, 
tteiagemmt md Operational Re\de^ of the South CmolJna CCTmlsslm m ffl gher 
Education (June 14, 1978) recmronded chariges Inaffi monbership and In several 
aspects of GE operations In pluming, budget review and protean review. 
Legislation m 1978 strmgthmed WE powers and raroved institutional iMitierj, ^ Althoi 
the report ms contraversial in that it ©cplicitly disavoTOd my Intmtion of 
describing "Offi accor^lista'^ts/' the seriousness of the lAC effort tos clearly 
doronsttated not mly by the creation of the elaborate evalimtlm criteria, but 
also by tim ^tmsiva addltiCTial activities #ilch were imdertakOT, Cov^lng OE 
developcients stoce Its establistaent m 1967, the lAC audit staff interviewed 
56 persons, niDstly frCTi the raiks of hi^er education, observed Offi TOetlngs md 
ccmitLttee Actions ov^ a nine mntii period, visited coordtoattag agencies in 
Alabfflna md Tmiessee, inspected agmcy plms from 17 other states, ffl5)loyed 
sev^al out=of»state consultmts (includmg me of us) to evaluate specific 
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aspects of QE operations, and conducted a i^er-sijcvey of 234 p^sons ixi the 
State concernteg the quality md uaefulriess of stodlas md re^rts. Clearly 
the HvalijatlCTi crlt^ia were epamed m m attiDsphece of high, professional 
pi:rpose. 

AltiiDiigh the full set of criteria presented below Jji their mtirety is 
rattier long, it is lnportmt for tiie reader to gcasp ^eir memiJig in order to 
mderstmd tine respondaits' reactions md ouc later cOTposite set of criteria. 
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Audit 77-4 Soutii ^roluia Legislative ^dit QDimcil 

Conffnission on Higher Education 

Detailed Audit Plan junc 27, 1977 

Overall Purpose: 

The purpose of this audit is to cxmino the duties nnd responsi- 
bilities of the Coiranission on Higher Hducation ajid to evaluate the 
parformanca of those duties, ^ 

I. Ajialysis of Goals and Objectives 

Goals and objectives will be analyzed to dctennine their 
confoniiance with legislative intent, the extent to wJiich they 
are a meaningful and useful guide for the Coimission 's oTrorts, 
and their comparability with goals and objectives of other state- 
wide post secondary coordinating agoncios, ' 

IL Evaluation of Progress Toward Goal Achievement 

A, Evaluation of the perfonnance of the Comission nnd the "1202" 
Post Secondary Planning Comnission in conducting studies and 
developing plans regarding the roles, structure ajid operations 
of post secondaiy institutions. 
1, Research Questions 

a. Has the output of studies ^ pbinSp rocoiiDiiondations been 
surfflcient in relation to the staff size,, fundingi and 
the demand for info mat ion? 

b. Have the important issues in higher education been 
addressed by txi?iUli;-s reports? 

c. Have the plajis, studies aiid reports thoroughly discussed 
issues, presented understandable, vnlif^ and useful infer- 

j mation and made specific, actionnhlo rccommcndntions? 
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d. Have decision-makers in higher education and State 
Government utiliznd CI IK plans, studios and reports 
and how has the qu/ility of higher education been 
in^jroved as a result? 

e. Has the QIE obtained sufficient participation of 
interested groups such as university and college 
presidents in the pliinning process? 

f. Has the CIE developed a master plan for post sccon- 
di;ry education which has been used by institutions? 

Research Methods 

a. User survey: Devolopmont of a survey instrmncnt 
designed to obtain from recipients of C3I1; studies .-jnd 
reports their evaluations regarding the quaHty, use- 
fulness and impact of major CUB studies. 

b. Personal inten/iews with imivcrslty and college presi- 
dents, academic deans ajid otlier know] Rclgeable persons. 

c. Analysis by audit team of significant CHR studies and 
plans. 

d. Evaluation of the overall quKlity of CHE reports and 
plans by individuals outside South Carolina having ' 
nationally recognized expertise. 

Measures 

t 

a. Measurement of the extent to which the CHE has addi-cs;;ed 
issues mandated by the Legislature by comijnring the topics 

. of reports to the topics specified in (HH enabling 
legislation. 

b. The proportion of users wjio rate QIE publications as use- 
ful, of highfluality, and provide examples of inipnct upon 
the quality of highcf cducat^ 



c. Ratings of the overall qiiality of roports hy individiinls 
outside the State, persons interviGwed and the audit 
team, • * 

d. Comparison of issues addressed by CIIE to nationol issues 
important to higher education. 

4, Criteria ^ 

a* South Carolina legislative mandate* 

b. Minimun recoimendations for State-level pUmning docu- 
ments made by the Carnegie Corranission on Higher 
Education, 

c. Model criteria proposed by the staff of the California 
Joint Committee on the Master Plan for Post Secondary 
nducation. 

Evaluation of the perfonnancc of the CoiiDnission in ^ubmitHne 
reconmiondations to the Budget and Control rsonrd and General 
Assembly regarding institutions of lugher cducnLion, 

1. Research Questions 

a. Wiat recQirancndations have been made by the Cllfi? 

b» Were the recoimiendations conuniuucatod to dccisjonMiinkcrs 

in a concise, meaningful and useful jiinnncr? 
c. To what extent have the rcconunendations led to action? 

If not, why? 

2. Research Methods ' 

a. Review om publications and compile n list of all 

rcconDnondat ions, 
b* Mien .possible, docinnont actions tnken and by whom 

to implement rccomncndations by rovicwjlig nctions of 

the Lcgisloturc, Governor luid institutions of higher 

education. 
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3, kmm 

a, liie extent to whidi OIH miradAiion'; !iave led to ' 
' action. ^ 

TliD extent tD rfiich actions bBSid on Ql rocoiicnda* 
tions Irm rosiiltod in inpvcmonL^ in post socoiidaiy 
' ' ■ odiotion. , 

4. Criteria 

^jlE rocoiiendations stiould cause cliiinges wliicli iiiprove ^ 
! the quality of post socondaiy educationi 

C. Evaluation of tlie perfoiiiiice of the OE's review of annual 
apprcpriation requests and dcvelopoient of recoiiondotions 
regaTdini State Wing of higlicr education, 
I Rcsearch^yestions 
a. Does the fonila provide eqyitablo diHtribiitiun 
of funds? 

Are the a^^iptions upon which the foiiiiula is ba^ed 
valid and justifiabW 

c, Should the UIE have the responsibililf for renewing 
appropriatioiis? 

d, Has the formula been iikj by ihe Budget end Control 
Eoard and/or the GenQral Ajsciiibly? 

e, Docs the fomiila proiiiote quality odiotion aiidj if notj 
is it possible to reconcile quality cdiiciition with 
foimula budgeting? 

I Ooes tho fbnnyla promote chanps in institytions otIs- 
tent with other rcconendation^ iide by tlio Conniisiion? 
2, Research Mothods 
a. Interviews with iiislitiitional presidents and vice- 
ERJC prcsidci)!:! for biiHiiiess mi State hydiet officials, 

3"? 



b. Trace the dcvelopifii^ of the imk, identilyin| 
reasons for changes. 

c, Qieck the validity of the tala^ utilizing current 
jfational rcsaarch and evaluations of iiidivictals 
with Mtionilly recopizod eiprtise, 

. , i DotrainewliGthorall institutioiisysciBiifoiiiUiil 
accurate data in coii|)utiii| ilic foniiiila, 
a. Study the integration of plity measures in the 

TonnossoG appropriation fonila, 
f. Wm all corrtspoiidcncc, iiiemoninda, and other docu- 
raonts relating to the budget process for the M six 
years, 
3, Heasyres 

a, Cofarison of Qi recoimicnded fmding to Budget and 
Control Board recoiiendatioiis and actiia! appropriation 
for tlie last four years, 
, b, Judgciscnts of higher education and Slate budget officials, 

and national eprts rcgardini validity of the under- 
iFing assiiipiioni of the foiiula, 

c. The extent to which appropriations are based on factors 
which directly relate to the activity heiiig funded 

(e.g, physical plant ifflintcnaiice based upon the character- 
istics of physical plant nge and S(|iaro footage), 

d. terc the extent to which percentagos and other cal- 

culitions in the fomula deviate 'frcsii to™ institutional 

needs and dutciiinc the overall impact on the accuracy 

I 

of ik foiiula, 
i Criteria j 
3. iLegislitive mandate. 
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b. OE criteria. Tlie Appropriation ronnula provides for 
oqui table shnrinc of State taxpayer support for South 
1 Carolina's public colleges and universities. Realistic 
iLmip-simi appropriations are conqiutcd kpartiall^ by 
using actual enrollinontSs proven student/faculty ratios 
. imUom salaiy assiBiiptions, mid justifiable average 
perccntagos to cover the agreed functions of the insti- 
tutions* 

Evaluation of DIE approval of new academic progrnjns and elimina- 
tion of uanecessaiy duplication. 
1, Research Questlcns 

a. Has program review promoted high quality, neccssaiy 
prograjiis ajid prevented imneccssaiy duplicatJon of \)vo- 
g ranis? 

b. IVhat cost savings, if any, have resulted from the 
clJinlnation of Lnnccessary prograjiis? 

c. Is the criteria used to evaluate prognuns fair and valid 
and is it perceived that way by the Jiighcr education 
coiiDnunity? 

d. Do the program review procedures obtrin noccssary and 
reliable information and allow for sufficient insti- 
tutional participation? 

e. Does the Qffi review the necessity nnd quality of oxistini 
academic programs in an adequate manner? 

f. To what extent have institutions been able to circiiin- 
vent or otherwise negate the GIB piograjn review process? 

2, Research Methods 

a. Prepare a statistical summary of ciuiiulntive data since 
1968 including programs approvgd, programs rojcctcd or 
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withdrawn, cases where the quality of the progrfiin was 
significajitly altered during review, and the likely 
I costs asfiociated with approved and rejected programs. 

b. Select a sajnple of progrms approved and rejected 
and examine the criteria used as a basis for action. 
Obtain justiflcaticn of criteria from CIIH staff and 

F 

solicit evaluation of th.e criteria by the affected 
institutions. 

c. Review the prograjn review procedures and compare to 
otlier states' procedures. In the case of the revicvv 
of existing prograjns comi^are with Florida, Wisconsin, 
and Louisianai 

d. Interview CUB, staffs Cormiss ion members Ces])ecially 
members on the Stimding CoiiBnittee on Academic Program 
ncvclopmcnt) and academic vice-presidents or provosts 
at institutions, 

e. Follow the progress of proposod new academic programs 
through the Suiimer 1977 review cycle including meeting 
of the Advisory Cononittce, Standing Coiiuiiittec and 
Conmission approval or rejection. 

Measures 

a. Ratings of perfonnance from persons inlcrviewed, 

b. Dstimate of cost avoidajice achieved by rejection or 
withdrawal of UJinecossaiy prognmis and elimination 
of existing prognuns, 

c. Audit team evaluation of quality of staff work and 
criteria utilized. 

Cr i toria 

iG 
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a. Prograin review procedures not only miist be fair and 

finn, but also mu^t bo porccived as sudu ? 
lb. Duplication may be necessary in progrmns with a high 

demand or which coinprise the core of a general cducationi 
but in the more esoteric subjects whure dcinand is small 
and in the more advu/iccd and professional degree prograjits^ 
where costs are high, even a small degree of duplications 
may be inuiecessary, 

c. Program review procedures should require now programs 

: to meet' reasonable tests of quality and not unnecessarily 

duplicate existing progriinis* 

d. Coordinating agencies should cncourago the termi nation 

of luisuccessful or unproductive programs, new or existing. 
E. nvaluation of the overall adequacy and efrectiveness of the 
Coiiunission. 

1. Research Questions 

a, Miat would be the hi^uct of eliminating the CUB? 

b. ^ver tlie past ton years has tlicre been any demonstrama 
relationship between activities of CIIH and iii^irovemonts 
in post sccondaiy education? 

2, Rescnrdi MetJiods 

a. Personal intei^views, 

b. Statistical analysis of cliangcs in indicalors of the 
? cjuallty of higher education from lDfi7- 1977. 

3* Measures 

a. Judgements of persons interviewed. 

b. Analysis by audit roam of inniact of Clin on chnngos in 
quality of post Hucondaiy education. 

er|c ' ii 
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B, Critical ReactlCTis from MBpmdmtn 

to pr^araticn for tiie T&riLm of the Mabma Comissicn on fflgher EducatlOTi, 
the second Evalmtlon Tern in 197B mailed cc^les of the Smtii tooltna criteria 
to some 70 persona a^oimd the county and requested tiielr critical reactions. 
The expectatlOTi ras ^t a set of OTit^ia could timi he developed timt wuld be 
memingful in evalmting tha AlBbmsL ComisBim. Respcnses TOre eoHclted 
from statewide agencies of Iri^er eduo&tlOTt, ^e IM staff in Soutii terolina, 
groins like the SouttiOTi tegiorml EducatiOTi Board md Hm Western liitffl^state 
Caipact for Hightt^ E^Mtion, ti^ ^M^icai Comcll on EducatiOTj Ittddle-States 
Accreditation, the American Asscciation of Itaiverslty Professors, the Carnegie 
Cornell and asSOTted to^i^dml scholars of state^de coordJiiatlpn md plmming 
of hi^r educatlcn* Recipiaita were asked to commt (m a conPldmtial baais, 
if desired) on the potmtial utility of ttm South Caroltaa criteria as a imdel 
for Mabama and o&or states, and to suggest modiflcationa as Eieceasary, Ihe 
followliig obs^nrntlonB are baaed on the 40 relies \Ailch were received* (See 
^pmdibc I for a full list of the reapondmts.) 

AlthoLigh critlcl^ of the critOTia covered a broad array of isauea , there were 
four major concerns tlmt siirfaced. T^eae dealt wiai a fine and precise 
measijrenent of tema, the political dlmaaslOTis of ^e ci^iterla, the balmce of 
caistitueicy totervlCTed, md failure tu address the agmcy's role as It relates 
to the acsdenac ccsmsriity and the State. It tos deaned lirportant, therefore, 
to Include specific coranmtarles on there issues, 

1. Difficulties aicoimt«ed in a precise md fair raeasuranait of terms 
like "sufficiait,'* '-equitable," "^rovemait,*' and "qtiality/' 

The remarks of Morton reflected such a concern: . 




geierai, tim approach as outliiied tes a £la\cir of objectivi^ 
but in real appllcatian TOuld lively be s\&jective. Ihis is 
becai^e so wmy of the crlt®rm are not specific md leave rom 
for alinost absolute wlue, jutignpnt. 

I TOuld si^esr a tro-p^t approach--one ^farein dOTonistrably 
objective criteria can be applied aid the oth^ frankly md opaily 
the application of diese judpmtal TOasuras ^ich defy mrm a niDdlcim 
of objectivity, 

2, Difficulties associated ^th the political dirnmsim of the tapliclt 
stijective aspects of ttie ewlwticn crit^ia, 

Sirotkin noted ^t the specif icatiais "at pomts, . .go beyond assesenmt of 
quality of product md process toto deterimnatte of consistmcy with preccfficeived 
Judg^ts/* 

Usdm tomd It uportrnt to be more ^lieit about my precOTiceived judg^ts 
relattag to the political process i 

the cri tK'ia seem sane^^t mechanistic aid not pitted :u:ito the 
political djmaniics that are so mtal to the effectlvCTesi of 
ally state board. In othOTTOrds, die idios^cratic natijffe of 
politics ixi each state aid tiie educatioml-polltical Int^lay tiust 
be TOre specifically addressed. It is steply tmfair to ^vAgm m 
agancy . and its specific actions tdtiiout ^licitly aedriiig to underatmd 
the political realities In my givm state contact, 

Mmig the political realities NOTri^ fomd govMnmental 'Mddm agendas'* for 
stat^de coordinating boards (e,g. , "promdlng a buffe In dealliig \dth 
politically diffioilt issues gm^ated by local imtoitlons") ^blch ' 'should be 
ackiowledged and e^;almted as part of the au^t desipi,'' 

Mlll» elaborated at som length on the iB^ortmce of ^e siAtler political 
dliiaisions : 

. . ,my agmcy wrktag in the political decision-maktag axmrn 
frequmtly f tods it ^ae to mrk tadirectly or beMnd the 
semes. Both actiw^ties TOuld not be obvioua but nw^theless 
TOuld be real. It should be possible for m evaluatli^ tean m.th 
its political sensitivity to identify t^e ageicy effectiveness 
along these lines. After it has bem idmtifled it ^11 be 
necessary to wite the report c^efijlly in order not to desttoy a 
good thtog. ... I TOuld m:^est, . , the possibility of looking at all 
of tte criteria. . .on a second scale #iich e^luates each In tmmm 
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of effecttvaiess m these qualitative or jidpiaital ways. 
Oa such a scale it could tuen out that tiie higher eication 
agaicy got high niacks for i^rliig part of the legislative 
mmdates because it TOuld have hem politically oe educationally 
unwise to tave attaipted to Inpleineit it, Anotte aemple of such 
msdcei wuld be cases in ^Mch tiie political cost could be Ji^ed 
to be hitler than the bmafits to be gained. 

The scale should also t^ into account die extait to ^^.ch the 
egmcy establishes a gaieral cllmte in Mch. craistructl^re activity 
occtffs. Wtei si^h a clMBte ^sts, it oftai is because tiie state 
agency hao beai mlling to sh^e credit for accomplistnients which it 
played a major role In. The evaluating cotitaittee should look for 
and recognize this qualitative factor or set of factors. Oftm tiiey 
will show \^ in situations in w^ich the fact of shartag reduces the 
quaititative ^score. m some cases it will aeate a situation in tMch 
the apparfnt lead^shlp or evsi tte real leadership will have bem 
taken by othsrs but tte state agaicy mil have eith^ s^ed as 
catalyst or mil have beai responsible for creating a climate in which 
odh^s woiild be mt^ested and willing to take lead^ship. Finally, 
tim state ageicy may havre created a climate In whidi there Is a gmeral 
WLlllngness to accept lead^ship frmi nid.tiple so\ffces whereas at m 
earlier point In time in the sme state the situation may have beai one 
:m v*idh sotre participaits in the process TOuld accept mly those thlnp-a 
Miich they flianaelves Initiated. 

The agency shoiJ.d be judged in trans of t*iat is possible In the 
particul^ setting aid tile particular situation givei the tlnies, resources 

attitudes, etc ffodest accamplishmait In seme settings takes imre 

ability than major ones m a differait setting. 

3. Lack of balance in the ccnposition of cliaitele int«viewed. (toterviewlng 
was limited prunarily to university md college leaders.) 
Norris: 

There is no visible awaraiess of the need to "cansida the sowce" 

avalxiating and weighing the information received from the 
various sources to be mtervLerod. Oa some 'of tiie Indicated 
factors it would appear that indepmdait e^ert judgnaita of pecsons 
well r^ved frm the local scoie are a more reaJiable basis for 
conclusiciis than opinions a^ressed by constltuaits ^^ose ox may have 
been eitiifflr gored or gorged. 

As an ecample of the "gored at" problan, Hollander felt tiiat the proposed 
crltttia and methods created imrealistic e^ectatioiis which / lould be hard for 
my agaicy of state govemnait to nteet fully." To rely predominantly for 
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reactlOTS to activities of my agaicy on its potmtial ai^mdeA, he noted, 

TOS not to anticipate favorable res^ises, 

Ttm, five respcndmts iff gad that ^ecutivm and legisiati\^ branch persoimel 

in state govermaits be added to the mte^vLm list, md Vsdaa suggested timt 

influ^tial lay flgiffea firom ^otqps like the ah^>er o£ Ccraterce and the League 

J ofi Mcmm Voters be iMluded as toU. * 

Ifiller pointed out that, regmdless of a respOTidmt's particular position 

md InvolvenKit, soire observers are 'tore con^clng for #mtever reason" aid 

that no roCTi was built -tato the eA;^ijatim process for giving "differential 

TOi^t" to si^h opinions. This is an element of concern particularly in "use 

surveys" in which no Interviexrer operates to sift the value of what is 
received. 

4. Failure to address agaicy's role in relaticnship to tiie acadenilc 
comamity and state govett^^t* 

If previous ccimmts havm alected us to tiie need to distdn^iish bet^em 
objective md subjective data, to tte vali^ of iMMng at the statewide board 
In political as toII as operational terms * aid to tte In^jortmce of seeking a 
TWich broads rmge of oplnims, the next ffoup of tdommtB criticizes the 
South Carolim criteria far tiieir failwe to deal tiie agency's particuiar 
role Jn relationship to the imiveirsitles and colleges md die statt ^overnEomt. 
For e^miple, IMday cmsiders tiie coordinattag board TOdel itself to be taf^lor 
s:^e "a body tlmt has little or no govttnance authority Q$mot have mch effect 
on (the) vital fimctions (of delivering teacWng, research smd a variety of 
public s^mces to the state)," mas to him, critwia to waluate a coordinating 
board mthout COTislderlng the possibility of bett^ consolidated governing imdel 
act only to miss the cmtcal point. 
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with 

review trere approacMiig that ccnplec and saisitlve topic / too mrrm a stress 
on cost sa\dngs and too sin^jlistic an lulled defmlticn of d^licative programs* 

Some^tot related observatlotis by Dmlop md EocresbOTg on the need for 
evaluation crltecia to assess llrikages betrom pro-am review md a) plmning 
and b) budget allocaticns, md also those betweoi budget allocaticns md plamlng, 

Arc^ieaux noted timt capital outlay procedures needed to be included as 
well^ md Schra-dtleto and Peteram si:ggested ^afr agmcy staff quality ou^t to 
be examined. Petersen and Cole tote concemed with detecmintog whetiier m agmcy 
is merely a ^'respcttisive conrisslon'" or ^^ther It dCTonstrates Initiative in 
anticipatii'jg OTerging iswes, 

Tioree of the respondents were particularly Interested m ©cplorlng the tepact 
of ellMnatlng the C3E. • Ttiey ^estloned the denm^trable relationship between 
activities of Qffi and u^rcrvemmts In posu^ucondary education. » 

Mllett, as a good social sclmtist^ ^onizes over problOTS of domnsttattog 

cause-md-ef f ect : 

The only satisfactory method of social scl^ce research for 
these questions TOuld be an eqpertomtal situation and a control 
situation. We can resort to this methodology in sane kinds cf 
psychological sitojatlonSj but it is pretty ^fficult to get 
©cpefliiierital restits and control restJ^ts m a political or economic 
setting. 



cm say vAiat TOuld have bar ,^4;^ in South Carolina betweoi 1967 
md 1977 if there had been no COTcnission on Hi^Qf Education? 
Obviously, we cm't relive 1967 to 1977 mthout-tiie Comiisslcm, It 
TOuld be tateresttng if we couid. To be swe, some tofonned 
partlclpmts md observers may speculate with sme reason abbut 
South Carolma evmts in the absmce of the ConmLssiOTi. But their 
observations remain speculation. 

You can look at sone statistical measi^es* nimber of carvpmBs added, 
new progTOTS authorized, new building cmstnicted, appropriations made 
for cijnrrmt operatims, mrollniQit by comtles, md de^ees awarded by 
progrffln field md leveL But ho^^ can you kiow i^dietter or not any of 
these qumtltative changes occrared because there ras a Ccrarission on 
Higher Edi^atiai? I would ^ss that tte COTmtsslm helped to pro^dde 
the rationale for change, helped to leglttoatlze hlgh^ educatlai 
progress, assisted In '-sell^'' higher education to the pome stwcture 



and to tiie political represmtatlvtes of that po^^ stmict^e. But 
I am guesstag, Ifeybe tiv^e is a bett^ ray to msmt. I hope so. 

amlap suggests mmg the abseice of negative ^dmce to dmonsttate a 
positives 'Wiat ni^t teve happmed of a negative natwe ov&r tinm past yBorB 
Md riot the OamLBsim on Hi^^ Ecfecatim bem to pUce?". 

And Yomg wmd^B ^gtetii^ the LAC cpjesticns just quoted abOTe TOuld 
nficessarily assess the costs as well as the bmef its of CoraitssiOTi activities: 
"Plaiming^ v&vLm and aiaditlng agmcies hmm difficulty tacklirig the question of 
the real costs of their activity, mmy of #iich are transferred to the ' 
institiitiona provi<Ung services." 

We received niffi^oua cautions about the dmgecs of iising evaluation criteEria 

based on Soutii Caroltaa"-or mm a "tetional niDdel""to my o^umc particiJ,M* 

state, Godwm provides one sudi mawplei 

EKcept in cOTtaln eases one may f tod tiiat criteria that cm be 
^[ually applied to dlffMimt types of state higha: education 
bowds w^ld Ipve to be so general as to be inccMicluslve. * . , ^ 
evaluatioti of most assistmce to a stete and to a Mgher education 
agmcy might be one that foci^ed prli^ily on higher education 
issues inportmt to the state md seconcterily on cco^arable 
stmdmds or criteria for eroluatlng the state agai^, 

KirkwDod reinforces this TOrntag: 

Given the nuoiber of variables ^sMch irake onm state dif fwmt froni 
motiTyer, I ^gi^ld question the a^^sability or the somdhess of 
sedcir^ to coo^are tl^ wrk of one ccmoission on hi^i^ edt^tion 
with that of my other state. Kiere mil be some cannmallties , 
but guess is ^t the difference mil be niore nun^ous tiian tiie 
likenesses, ^ 



VI, CCjdPCSraE SET CF ^TIRIA 



Msed on the critical reactiOTis s^veyed In the last Section, have developed 



i7 
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a ccoposite set of ^It^ia coverliig elevm different Mtegories. We wuld not 
for a nianmt suggest fliat p^sais evaluating statewide boards should attaipt 
to use all mm various crit^la listed. But it is am hope that evaluatmrs could 
pick md choose those criteria wost appr^rlate to their particular state history 
aiid contect, 

Pnd for the faint-hearted who are intJmdated by tiie prospect of digestiiig 
mother long list of assessinmt questlms. we oCfer relief in tim fram of "fbtc 
, shrart ••ovecriding qi^stions" stimtted by Stephen Balley/Jn 11^^ daSled 
critical reactions to the Soudi Caroliiia crit^la which he foimd "silly md 
pretaitlous" md lacking "analytical focus md conceptual clarity".. 

V^J"^ Is the Intellectual/malytlcal work of the COTnisslon of hldi quality? 
Here, a pe^ review of selected reports md studies should be adequSe?^ 

r' ?^ ® sense oi the pact of the governor md the leeislature that 

the toimssion's activities are helpful to than in m^Jng at l2stiSsi-rSnn«i ' 
ji:dpents about Mgha: education si^port md develop,^ quasi ratiOTial 

A^i^' affected colleges md universities feel tiiat they are belne 

dealt with by the CcmHssim In a fair md md^stmdingmS--Smt^ 
distigreanaits about flml recamendations? - grated 

4. Does the Camilssicn operate an the bals of a philosophy of hlaher ' 

^^r^^.^^^'"^ °^P^^' occt^Itlonal! Ld fSSI 
projections, and that mdOTses a nHsaimmi aioimt of institutional autonotw i't, 
making decranaital as well as Incrmmtal decisions? autonony 

■m follomxig commts, suggastlons and questions COTistttute the 'tag List." 
A. Rrevlous Evaluation 

1. The status of the recamendations made by my previous evaluations' should 
be consldeared, 

Cromtsslon teifcership 

1. How does the titentershlp differ Stot other states? 

2. How are the maimers ehosm? ^ they be easily influmced by the 
Institutions? by state officialf.? 



3* Vttiat decislms can or cannot be mde becaiiae of ahje iia^ershlp? 

C. to nrdsslcm Staff 

1, Vas the staff stmm initiative in raismg ne&g Issues for cooc^n by 
the conndsslon; by die legislative? . 

2, Ifas the quality of the conmission staff bem strmgtihened since last 



3. How sttong has the director's leatoship bem? 

4. Could other HJEA's leam mythlng al^t effective Intemal mmagaient ftco 
tiiis caimission? 

5. vaiat is ttm capacity of the staff to adjust to nm needs aid u^rove 
rnternal fmctioning? 

6. How do staff salaries conpare to those of other state agaicies? Bow do 
ffi^coopare to those of the institoitiotis in Urn state? 

7. staff md other resoittces Me available as carpared to staff and 
resom-ces In other agmeies with amila^ fimctlms? 

D* Original Legislation i 
General COTnmts: 

- Effe^tivmss of the Ocnrissicn should be TCastffed against the legislation 
establisMng the agoicy* 

Authority I 

" A postsecondary ccnmssion ai\n.BQry po^mo is likely to iiiflumce 
policy uidirectly over the long term, most liJcely to be effective in 
defini^ ^e questions to be asked md ^e lasuea to be adcfcessed. 

- A coordinating board is less likely to be able to resolve issues in 
accordance mth their views sl^ce t±e resolution mil rest in the hmds of 
otheat boards with other authority, 

ERIC iB 
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- Ttm natoe of a coordmatlrig bond's fimctlm Is l^ly to result m only 
a i^rtlOTi of its reconmmdatims being accepted aid only a pOTtion of its 
pr^sals being able to directly relate to oitCOTes. 

- Sidirect liif lumces are most signifioint md these must be md^stood md 
perceived, by the eTOluatli^ kgmcy. 

C^miOT: A body that has little or no govraimce authority has little 
effect an vital fmctions of teachtog^ rese^ch^ etc. 

1. E4d the legislatlm give the agmcy sufficiOTit authority to operate 
effectively? 

2. Were porors ^.ch originally provided sufficimtly utilized? 

3. Wd tiie TOrd^ of tte statute agree with eitiier natimal norms aid/or 
local consensus regardtog ^Amt tte s^mcy m^t to be doing? 

E, Goals and Obiectives of the Agmcy 
Goieral Coni^ts" 

- The agency shDuld list its am goals md obj actives md se^ its am 
evaluation of how well these objectives were achieve, 

- It is leas apprcpriate to talk about tt^ "goals md objectives" of a 

state agency, thar. to taUc about its fimctiona, ''duties and responsibilitlea 
as per stateiCTit of ov^all pL^pose, 

- If a particul^ action dLrected by state Im remilted in a decline in 
quality or no slgaif icmt liiprov^mt based on soffi national set of 
stmdards, the aidit team's results BtmiLd reflect wliy tiie Conmission diose 
that course or action, 

1, HaL ^e tomission devalued its own crit^ia fra Him eTOluation of its 
perfcnnance? " 

2. Has ttere bem a ''self-waluatim" by the Commlsslai? 



3, To ^tent Mve ti^ recatin^datiOTis of Camissicn led lu action? 

4, Is this only a "respOTSlve" tomission? 

5, Has tiie COTmisslon develc^ed gm^al prmciples of acatodc ^celloice 
against it evaluates hlgho' ediwatlctti to the state? 

F, SmisitlviCy to the Political Seme 
General Comnmts: 

- It is iffifair to jii%e m agency md its specific actions OTthout ^Itcitly 
sedctag to mderstoid tiie political realltieL m any glvm state context. 

- Often it is necessary to wrk mdirectly or b^tod the scenes. It could 
turn out tlmt m agmcy may teve J.^ored part of legislative mmdates 
becai^e it would have bem politically or educatiOTally irartae to have 
attested to inplanmt tiien* 

- ftrtoa^^ responsibilities md goyen^ce role of die facijaties shoaLd not be 
ovffl^looked, 

1, Has agmcy exCTcised Judp^t m cases m tdie political cost could 
be jigged to be hi^^ thm the bsieflts to be gained? 

2, Has the agmcy established a gmeral cllmte to \diich cmstructlve 
activity occinrs? 

3, Itos tiie agency been trilling to accept lead»sM,p foai tnultiple sources? 

4, Is ttiere a smse cn tiie part of the gov^nor and the legislative that 
ttie <_:oomdsslon-s activities »e helpful to t±m to mAtog at least quasl-ratiaial 
Judgmaits atout higher educatlOTi SL^port md davelo^«it? 

5, How has hi^er education fared to obtamtog tax dollars ftm ttie legislature 
over the past five or tm yems to amspoxtsm mth other gov^maital fmctlOTS 
such as hi^iKrays, cctimon schools, etc.? 
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6. Itow has M^iac education's workload Increased eotrap^ed witii workload 

increases of other gOTermental fictions? 

7. ]Wd tte coGrdinatu^ board make recmTOndatlons ^Addi ymrB specific 
.rLOO^ to be liiplQimted? Bie ©ctmt to #ilch a tonrissim's recomMidatiOTS 
are not mglmoit^ may reflect en other groups outside die CoEEnissicTi. 

G. Relationship to Postsecoodajry tostitutiona 

1* Do the affected colleges md mlversities feel ttet tiiey are being dealt 
In a fair and mderstanding mmnar--^mted dis^^eeamts abmit finri 
reconmendatlais ? 

2, To ^^t ^tmt do inatituticna go directly to tiie gamcmr and legtalature? 

3. To x^t ^tent do institutions ca^iy out policies devei^ed by tiie 
Ccmnissim? Are tiiey re^jlred/©^ect to? 

H. Flaming ^ocyss 
Gaieral Commts. 

- jtoiy COTmLssloTi that has done Its job prcpecly '^^pould be h^d put to find 
college presidmts mxic^ its ccnstituaricy TOiid a|^ee OTthusiastlcally 
ti^y had hmm involved to tiie octmt fliey believe tihey shoiJ.d be In the 
planning process. 

- It may be difficult to f uid my state agmcy v^tese reports md recoirnimdaticfii 
are perceived to tiave contributed to a signlficmt my to hi^w education, 

- ^propriatsiess of bo^d actions stould be ireasuaced In relatiOT to state 
plffii tar Mgher education. 

1. M,d ifbm plmilng prodjcts idmtify tiiose gca^s rt^aiponslble for 
li^lenffltttog recarmendatlons? Wd they Include iflplaientatim plms? If c^tam 
actions wire implenmted, detem^e ^e&^ or not tiie desired outcore tos 
actually realized. 
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2. VJhat wDuld be the lnpact of elimlmtliig the Cofmisslon? 

3. Who cm say ^*at would have hsppmed since the last e\raluatlOTi if there 
had bem no CcmdssiOTi? 

4. Hcf&7 cm you know t*e^r or not my ^j^titatlve changes occurred 
because there tos a Coraoisslon? 

5. Has the Ccomiaaion tolped pro^^de the rationale for chmga, helped to 
legitimatize \±^&c edacation process, assisted In "selluig" hlgh» educatim 
to the pow^ stxucti:ffe and to political represaitatlves? 

6. Who ptttlclpates In tiie planning process? ^esidCTits? Citlzms? 
Other univi^sity^ adimmatrators? 

7. pmticlpates in the budget process, tiie prolan re\aew process? 
lAmi are Information systms md standards developed md ikiaintatoed md 
p^Llcipates In this proceAiS? 

8. To ^t mtmi In the plamtag process has in-depth analysis bem 
tmdertakai to mcover pertlnmt issi^s? To ^t ^tmt have solutions bem 
prqDosed? 

9. Does there appem to be a reluctattce to cansid^ Imoratlve aroroacheB? 

I. Rrogcan Revle&g Process 
CSmeral Cammtsi 

* No crit^ia have bem d^el^ed to assess tiie quality of flie results of the 
progpETOTi approval process, 

" ElJMnatii^ umecessary dt^lication assunteli ttiat the OomLsBtoa has 
d^l^ed its am miteria for ass. . ^Ing the wrth of ^acadmlc proems 
beyond flie gm^al legislative mmdate md, tteou^ practice md policy, 
has estabHshed Its ma stmdards of necessity md quality. 

- It Is practically lnpossjble to dTorot^ly ecfflnine the cost md quality of 
a prolan prior to inplmientatiai. The re^dew of ©fisting proprOTs 

53 



-47-- 

becQines OTKial, 

1. Wmt is the ralatlmship between pro^mi tenm md dgtetmliiatlm of 
budget needs? If me Is added, does new nmey go mtii it, md if me is dropped, 
is ttiere a reduction in tiie atoomt of resomces requ^ed? 

2. Does ti m Comrission have explicit authc^rity to r^ew tCTmlmte 
programs? 

3. Is there quality built Into the progcffli review process? 

4. ^e resoiirces pro\^ded to enable the Comission to adiresa qmlity 

isaues in tiie progran review fimction? 

5. Bow do iiew prograris relate to tiie state plm? 
J* Btidget ing Process 

^n&oal CammtB; 

- The coordtaatir^ boffi^d atould establish statewide priorities for fijnd'ng 
of hi^er education, 

- The CtoomissljDn must be evalmted on its mllir^ess to make hard choices, 
to balance the finmcial sitmtion of tte state against the ar^itiOTS of 
the InstitutiOTis, 

1* Does the Ccmiiission opiate on the basis of a philosphy of higher 
education that goes beyOTid steplistic nanpower, occi^atimal and formula 
projection, and that ©dorses a mfficnnm aiomt of Institutimal autonoi^* in 
making decrmmtal as ^mll as incrormtal decisiOTis? 

2. Does the board promote accomtability by helping the stats develop 
effielmcy md effectivmess neaomes for higher edication md related Jnstniiticml 
p^formance mth ftnidlng? 

3, In li^t of changtog conditions, does ttm forniula-based budget give m 
accurate portrayal of m institution's flnmcial needs? 
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4. Are budget requests in keeping with m overall state plan for higher 
education? Detailed budget malysis nay or may not be assipied to a coordinating 
agency J but certainly the basic rmvim against long-rmgu^ plms should be cotiducted, 

5, What is the Ccmnisslon's role m influmcl^ ^e capital outlay budget? 

Reports and Studies 

1. Is the intellectml/malytic TOrk of tJie CoEimsslon of quality? 

2. Do studies teve significant tepact in the specific areas they ad&ess? 

3. If a CoOTrission study results in a reccramdation to maintato the sta&js 
quo in some area, md ttie legislatoe agrees to t^e -Vio actlm" as a result of 
ttm recamendation, that is a positive role. Such m activity may not result 

in an idaitified inprovr.nsit m postsecondary educatlm, but It has clearly 
protected listing quality* 

4. Has the ou^ut of studies^ plans, reconiMitoions hem realistic as toII 
as sufflclait in relatim to staff size, fimdlng md danmd for Infomatlcni? 

VII. CONCLUSION 

A, Who Bells the Cat ? 

Whether one \ised the sli^lified Bailey **Big Foi^" or sOTte v^iatiOTi on the 
more elaborate canposite set of critCTia, the question arises: 'Wio bells 
thm cat?*'. 

Sections IV and V reviewed most formal evalmtion efforts to date, with an 
eiphasis on the evaluation criteria . Let us h^e re-travel that gromid with 
an aiphasis on does the ewluation. 

Ihe ACT : -V.f -Evaluation lat nentioned in Section IV cOTitalns guidelines put 
out by the Association of toverning Boards #iidi are immt to be used by the 
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boards on ths,iselves. While board self-evalmtion is a desirable practice, it 
is not a sufficimt answ^ to the problan of public accoimtabillty because of 
the obvious problans of bias aid self-interest. We will, however, reLimi to a 
variation of tliis idea in our concludirig ranarks to this Section. 

2. IMiversiQr of Mssoi^i Task Force: Ttds ^aap ima appointed by the 
I^esldait of the Itaiv^sJ.ty of Mssowi and took as its charge to recoimmd 
a coordteatuig structmre for the state of MssoiBfi based on its studies of 
tiie main three types of models in nine states outside MLssourl. 

While this process overcaiB problans of objectivity by dealing with out- 
of-state material, it also lacked the attention to specific ui-state problans 
^Mch Goctaui and Kirtarood mmg others especially trged be die primary focus of 
the evaluation. 

3. Alabama Evaluations #1 and #2: "niese evaluations were carried out by 
cotmiittees appointed by the statemde board itself after consultations with 
imiversity and college leaders. Each cminittee consisted of a majority of in- 
state persons having no direct associations with Alabama diversities and colleges 
and a minority (of at least three persons) ftom outside the state, selected for 
their experience with various eleneits in the coordiriatlng picture. 

This mixed coraiiittee had the advaitage of including in-state p^sons smsltive 
to Jndlgaious political caiditions and out-of-state persons arare of practices 
and problans In other states. Its major disadvantages w^e the lack of Its own 
research staff, a modest budget and a six-month life spai. 

Janes Mller, Jr. , a particlpait m the 1975 Evaluation Comnlttee, later ' 
assessed tlils evaluation and noted (1975) • 



The attrapt to secinre a of m-state aid out-of-state 
viewports and a mix of lay and a^^t TOmb^s appears to this 
partlcipant-obs^ver to teve wrked vmll. So also did the decision 
to tr^m the lay people mid ttie ptofessionals coequal 'teito^s" of 
flie e^luation cOTinittee instead of differsitiatl^ n^bers md 
consultants. Mentor particlpatiOTi m dlsoissiOTis was fre^, mm 
continuous, and rore mde-rmgJng tiian is toje ^lAim people i^e 
identified (or self-ldmtify) with Itaited roles such as -'^ort 
on state ^litlcs" or "©^ert on altematlve TOdels irm other 
states.*' Variations m ^)ertise w^e recognized, but Aey did not 
create bai^iers to toteraction. Such a coMttee sttuctmre TOuld not 
necessarily wrk in all situations, but it nffirlts consideratiOT as m 
aitemative to the more COTmn practice of brtoging to outside 
ccnsultimts to advise an to-state ccmiiittee of lay or legislati%^ 
leaders. 

The 1975 Corartttee recam^ded a change to the nBthod of appototlng the next 
me, Evm thcu^ M.ller reported tl^ Coradttee felt cOTpletely free to '^be 
objective/' the mCTbers felt that appemances of top^tiality wmld be better 
served i if the Alabana coordinating bo^d appototed only one of tiie foiir to- 
state niaters, with the Governor and the presidtog officer of each house of the 
legislature each appototlng me of the otiier three. , 

The four Alabama iiia±iors TOuld th^n, witii the help of the coordinating boOTd, 
select the out-of-state professimals to Joto ^en as equal naito^s of tihe 
Ccmnittee, 

This reccmKidation was tocluded to a subsequent bill to strmgthm the 
CopnmssiOTi, but as earlier pages reported, that bill passed only one touse md 
as a consequmce, the 1979 COTCiittee tos appototed by the orlgtoal ^tiiod, 

4. AED Studies to fflssissippi md West Virgtoiai The Acadsiy for Educational 
Developiait mdertook evaluations of the consolidate governing boards to 
Mssisslppl md West Vlrgtoia at the briiest of state govammt bodies to each 
state, (^e MB stiMy to Florida is a soM^*at differmt case md ^11 be dealt 
with below. ) 



The AH) brou^t both a teOTledge of ecp^iaices m other states md a potoitlal 
for Mpartiality to its stiMles x^hlc^ m-atate agmcies md persons TOuld find 
difficiilt to equal. Qi the other hand, if tiifjse stressing the prtaHry mportpnce 
of iml,quo itate ^aract^lstics (both edTOaticnal md political) are correct, 
tlim an ei^luation process ladclng smsitive in-state participmts may also be 
def IciCTit . 

5. MD Study m F].orlda= The AED stiMy m Florida contrasts mXh ttm tvro 
just menticned because in Florida liie cOTmissioning agent, the Joint Qcecutive-^ 
Legislative Cctrmissim on Postsecondary Educatiois is not a passive recipiait of 
the fi^ findings but is Itself actively mgaged in a broad Inquiry into post- 
seccodary education in that state, M a fi^th^ toterestlng ^rarlation, the 
Florida Study Ccmiission has asked s^ out-of-state consultants (Includtog the 
smior mudior of this stiMy) to ccEmrat on c^tam aspects of &e A© reports. 
Thus the Florida ex^le cOTfcines the strength of in-state persons, m authorized 
staff, m out-of-state professimal consul ttog firm md the use of individual 
out-of-state persons for ad hoc piloses. Miat it lacks Is s^ficlmt tdm.i six 
ironths is not enou^ for a careful study! 

6, Legislative Audit Reviews In Comecticut md South Carolina: Ttie 
Comecticut study is listed here along mth the South teroluia one nerely to 
^rarn observers not to Judge things by their outer labels. Miile both reports are 
products of state legislative pro^-an evaluation mits, the Connecticut me falls 
far shore of the high professional standards espoused by the anerglng national 
Legislative Ifco^am Evaluation (LPE) imit In the Watimal tomcil of State 
Legislatives. Even the tmch more carefully done South Carolma report fails to 
provide a balanced appraisal of the Caimission on Higher Education's achievmmits 
as well as its alleged shortCOTiings. But at least the South Carolina process 



stows die potential of a ttatoed professional evalmtion steff , adequate ti^ 
md b^get, and the use of selected out-of -state e^^imces, reports and 
consiitfflits, 

B. S^gigdis md We^iesses of Various Pattmis 

What needs COTe&l judgpoait is x^ether ^ gams m ^ploying state professlarial 
evaluation staff ^o are gai^ally ^^erlmced In evalmtlng piAlic policy 
i^lm^tatim but only paastagly fmlll^ mth the subtle nuaices of c^lac 
acadffldc issijes (tine staff nijst bomice frOT one poli^ area to motii^) outwel^ 
those to be ecpected fran errployMg pffiSOTis not ttamed in evaluatim tectelques 
as such but xAo me imch more sraisitlve to the acadOTic values involved. 

An alt^TOtive dileiTO is that betrom ustag a natimal consultliig firm that 
tes staff both ttalned in progran ^luation md specializing m hl^er educatlOTi 
Issues, but xAo taow less about tiie particular educational aid political conditiOTS 
miq^ ^o a state, md alloying to-state persOTis Mth the opposite stroig^. 

The Fiorida pattcnm COTiblnes toth the streigth of an Jji-state crrmisslon 
md staff mth that of a mtlOTial COTSiattog fizm speclaliztag m higher education 
prbblOTS, plus the ad hoc use of individml out-of-state prof essiOTials . 

The particular choice ^Alch a givm state may mAe mOTg tiie vmrious 
alternatives mil obviously oi^ge out of tiie cmdltions thm' prevailtog in that 
state, but Ideally the process of evaluation selected ^jld reflect sme , 
sensitivity to tiie above gm^al ^lysls of gains md losses associated mtii 
different evaluatlOTs agaits, 

Oae major variable In choostag the type of evaluation agOTt(s) ninges on 
xghether the assessnmt is to a built-m periodic practice or m ad hoc 
^rcise gm^ated only vhm the accunulatlon of crlticims of a statewide board 
seens to justify it. 
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The spread of s'jnset lagislation (inaicioned ixi Section I) md the Legislative 

Program Evaluation Tnovaiymt reinforces 'our reconinaidation, based on the Alabmia 
expa-imce, that tiie evaluation becOTE a regular process, not comected with 
my particular crisis or disagreeumt. 

If this is done, tiim choice of evaluation agents will have to take cost 
considerations imre carefully into account. M assessinmt to be imdertaken every 
four years, for mmrplm, my necessitate a imre modest hudget tiim one notmt^ 
only once In a decade. 

Whatever the choice of timing, budget and eTOluation agmt, another suggestion 
received has convinced us to recomaid that the process begin by asking the state- 
wide board Itself to specify the criteria by ^ch it hopes to be evaluated. 
Puller md Cooper both made this point, #ilch cmm with particular force fran 
Cooper, former sti^f maitoer of the South Carolina Legislative Audit Council staff: 

The audit plan/criteria were developed by tl^ legislative 
Cannission staff. That ma a mistdce,, Our first step, md I 
suggest you consider this as your first step in Alabana, should 
have beai to ask the Higher Education Cramiisslon to propose 
the criteria they use (or will use in the futiae) to eraluate 
their om perfomiance. One standard for any organlzatlm is to 
have a plan for evaluating its perfomance. 

crit^la 

Obviously the choice of evaluation^ wuld not stop with the .^tatffidds board's 
own suggestions,, but it is a good place to begin. The evaluation agmcy chosen 
should then mdertake a critique of the suggested criteria, discuss any dlsagceaiKits 
with the statewide board and thai finally establish the fonnal criteria. 

Once this has bem done in one cycle, the fficisting criteria will help the 
statewide board to monitor the accurmlatlon of relevant data so that In the nett 
evaluation process, most information needed will already be available. Later 
evaluation agents will always retain the right to modify or abmdon the earlier 
criteria (and the statewide board can always suggest changes) but over a psciod 



t±m, botii by trial and error in that state and thm pamr of ecmples frrni o^er 

states, thftre should oMrga a more satisfactory evaluation process. 

Haling said this to me aware that it ia cmsiderably easier to rarite about 

a good process t±m to delivo: on it. Few people or agmcies sem to mjoy being 

evaluated, md tiiia is particularly toie in high^ education #iere acadmics are 

fmd of sayiiig l±at ''delicate matters relattog to the life of the mind" caimot 

be crudely evELluated, Tn tit±s regard another nMiber of the South Caroltaa Audit 

staff (Cole) responded to oi^ letter by Idrfdng problfflp to evalmttog statewide 

boards to broader problCTs of assessmg outcoms In hl^a^ education in general. 

Below (mth her order soTOy*at cransposed) she f test lays ooit ^e Legislative 

Audit Council approa^ md dim issues a diallmge to acadgnlcg to mter the foay 

and try to do better 

Ihe evaluator se-^Lng crit^ia is iimedlately plunged into 
philos^Mc questions cmcmitog titie native of hl^K: education 
in general and State-ftsmded hi^er education m partiailar, A 
Legislative Rrogram vitiation agmcy must cmsidCT ^etti^ or 
not the ta^ayers are receivii^ tiie greatest bmefit possible 
frOTi the money to;ested in hig^r education. Prntic^m-ly 
durliig a tme of steuddng resomces and decltntag mrollnaits, 
die proper role of die piilicly-fmded uistitutiOTi becores an 
issue, Progrms xAiich a private institution may choose to off^ may be 
a liDo^ f or a public tostitutim, Eadi pni>lic institution shoid.d 
develop its pmticular straigdis rather thm attffl^tmg to grow in 
all directions. The coordlnatiu:^ board mast be evaluated on its 
mlllngpess to m^ t±e hard choices, to balance Ae finmcial 
situation of the State agatast &e anbitions of die institutions 
^le trying to promde the best possible edi^ational opportimities 
for the citizms of die state. 

. . , it IS ^p^ative diat hi^^ eiication agmcies place more 
a^i^sis on self -evaluation md developuig nBasures for assessing 
their om prograi^, Othmglse the task of decidtog the iesired 
outcOTes of such pro^fflns mil alrays be left to people outside the 
field of hi^er eiicatioru 

. . . the evaliMtion of such coordmattag boards is a difficult task 
becaL^e of a past reluctmce on the part of educators to qi^ti^ 
most areas of higher edicatiOT. VJhm the auditOT tries to ^amne 
tow the agency performs and assesses its prograns, he finds h^elf 
atteiptlng to evaluate progrms ^ich resist the very idea of 
measurmmit. 
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VMle educators of toi repeat the nyth that M^ier education canmt 
be nsaswed, several edicatOTS did egress to us the Idea that it is 
the acadCTlcifflis tliaKelves ^d:© have m inbDm resi&tmce' to 
quaritiflcatlon and accomtatlllty. It may ba me\dti)le tiiat this 
attitiMe is absorbed to sane ectent by tine re^olating/cTOrdinating 
bomrd. At the ve^ least, it Mdbits the bond's efforts to la^se 
nmsiicenmts . 

Howard Boroi is one scholar %^ has accepted tiie challmge of state^its like 

that ji^t quoted, B±b recmt book Investtmt to Leacntog (1979) pro^^des myLch 

Information on outcmtes to hi^er education aid he himself has well described 

tile central dilemas to attespti^ to ra^sure such outcores. We cm do no 

bett^ to md ^s wrk i±mi to return to tiie opmtog broad tiia^s of evaluation 

to Acad^te by associattog omaelves cmpletely vvlth Bowm'g plea (1974, p. 121) 

To evaluate outCOTes is dif f imlt partly because it is hard to 
sort out causes and effects, partly becai^e the ftaal outcores may 
not be Imom for decades md partly because scro of tiie mst 
si^if icait outccraes my be tnposssible to idoitify or ireasiffe to 
objective t^itns. Yet, de^ite the difficulties, educators have 
m obligation to assess outccces aa best ^ey cm, not only to 
appease outsiders ^gto danmd accoiaitabill^^ but also to ln^rOTs 
toternal nrniagsnrnt. , , .ThK'e are some useful proceduo'es fOT obtatotog 
quantitative data on outcomes, md ongoing reaeardi (^Mch should be 
miltipred many times) mil produce more \mys of measmlng outcomes . 
Inevitably^ towever, tiie assesOTimt of outcocnes xdll require l^ge 
elmimts of Judgmmt, One of ^e problens is to bring to be^ on 
evaluation the judgnent of professionally malified but ^stot^ested 
persons (1974, p. 121), 
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APPENDIX A 
Structure of State Coordinating Boards 

(1) No coor din ating structure - - s elf explanatory; 

(2) Vo lun tary as so c la t ion - - s cine coordinating structure, with greater 
or lesser degrees of activity, formed voluntarily by institutional 
Initiative • 

(3) Advisor y coordinating ag ency-" state-mandated" agency which does not 
supersede Institutional or segmental governing boards and gives advice 
and recotranendations on higher education to institutions and state 
agencies ; 

Regulatory coordinating agency --state-mandated agency which does 
not supersede institutional or segmental governing boards and has 
final approval powers In at least certain key policy areas; 
(5) Consol idated governing board --one single board which both governs 
and coordinates all public higher education within the state, except 
possibly public conmiunity colleges. 
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Proposed National Objectives for Hi^er Edication 



A. C rnegie Comijsion Eurposes of Higher Education (1973) 

(1) ^ The provision of opportunities for the intellectual, aesthetic, 
ethical, and skill development of individual students, and the 
provision of campus enviroiments whl^h can constructively assist 
students in their more general developmental growth. 

(2) The advancement of human capability in society at large. 

(3) The enlargment of aducational justice for the postsecondary 
age group , 

(4) The transmission and advancement of learning and wisdom. 

(5) The critical evaluation of society--through individual thought 
and persuasion--for the sake of society's self -renewal . 



B: National Comnlsslon on the Financing of 
Postsecondary Education (1973) 

(1) Each individual should be able to enroll In some form of 
postsecondary education appropriate to that person's needs, 
capability, and motivation* 

(2) Each individual should have a reasonable choice among those 
institutions of postsecondary education that have accepted him or 
her . 

(3) Postsecondary education should make available academic assistance 
and counseling that will enable each individual, according to his or 
her needs, capability, and motivation, to achieve his or her 
educational obj ectives . 

(4) Postsecondary education should offer programs of formal instructioi 
ad other learning opportunities and engage In research and public 
service of sufficient diversity to be responsive to the changing needs 
of 'ndivlduals and society. 

(5) Postsecondary education should strive for eKcellence In all 
Instruction, research, public service, and other learning opportunities 

(6) Institutions of postsecondary education should have sufficient 
freedom and flexibility to maintain institutional and professional 
integrity and to meet, creatively and responsibly, their educational 
goals. 

(7) Institutions of postsecondary education should use financial and 
other resources both efficiently and effectively and employ procedures 
sufficient to enable those who provide the resources to determine 
whether those resources are achieving desired outcomes, 

(8) Adequate financial resources should be -made available to permit the 
accomplishment of the foregoing objectives. This is a responsibility 
that should be shared by a combination of public and private sources, 
including federal, state, and local government, and by students, 
parents, and other concerned individuals and organizations, 
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APPENDIX C 

Related EKamples of Evaluations of Process 

In 1972 a two-year Educational Governance Project was funded by 
the United States Office of Education under Title V of the Elementar: 
and Secondary Education Act, Headed by Roald Campbell and Tim Mazzoi 
Jr., and based in the College of Education at Ohio State University, 
the Project produced case studies of twelve states and two major 
reports (Campbell and Mazzoni, 1974a and 1974b). IKt even a staff 
of four senior persons working with thirteen research associates 
over the two years was able to overcome the problems of assessing 
output rather than process: "No statements are made by us about the 
linkage between a given model and changes in such areas as teacher 
performance or student achisvement. Though we personally believe 
that structure can affect policy outcomes of this sort, the many 
intervening variables and the limitations of our data preclude any 
but the most speculative comnent" (Campbell and Mazzoni, 1974a, p, 
46) , 

In another example of their scholarly caution, Campbell and 
Mazzoni^ first note that ^'structures, intentionally or not, are never 
neutral. Each makes it easier for some values to be realized rather 
than others/* They decline however, to state their own preferences 
for which values ought to be realized. Instead they offer a 
description of the values of both supporters and critics of each 
of the major models analyzed (for example, those who place more 
importance on accountability may favor the centralized executive 
model, while those more interested in insulating education from 
partisan politics may prefer the separate agency model) . 
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Another major study-^-=thls one of state legislatures--also felt 
obligated to evaluate process rather than fmtcome but exhibited no 
reserve about professing which legislative structures and procedures 
ought to be valued. The Citizens Conference on State Legislatures 
received a Ford Foundation grant in 1970 to make a fourteen-month 
Legislative Evaluation Study, The resulting report (Burns, 1971) 
explains how panels of experts finally evolved five major criteria, 
employing seventy- three total subheadings, by which each state 
legislature was judged and rated. All fifty states were then ranked 
on each of the major criterla-"fur4Ctionality , accountability, Information, 
independence, and representation, and a composite state rating was 
offered, with California and New York leading the scores and Alabama 
and Wyoming at the bottom of the list. More Importantly, i ad on 
the ideal model, recommendations were offered for the improvement of 
the legislative process in each state. While the research team agreed 
that legislative results were more important than the means used to 
achieve them, it argued that, methodologically, evaluation could 
really \ni made only of process and that in the long run, this might 
prove to be the more crucial variable. 
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Topic 9 APPENDIX D Association of Governing Boards 

(1977) 

Statewide Educational Pianning—Policies and Processes 

1» Indicate your opinions regarding the board's past and present performance In statewide planning by 
re^sponding ''ye^*' or ''no" to the following questions, and if appropriate, whether you fee! that the practice 
needn refinement and updating, or whether a new practice should be initiated. 

Needi Should 
Yes No fefinemfnl inliUtf 

a. Has (he board adopted specific policies and long-range 





objectives io guide the development of postsecondary 
education services in the state? 


u 


1 — ] 

LJ 


LJ 


f—i 

LJ 


b. 


Are tfie methods for achieving each objective clearly stated • 
in a ' master plan'' or other public documents 


LJ 


1 — 1 
LJ 


LJ 


LJ 


c. 


Does the phn define the unique role and scope of services 
offered by each institution? 


□ 


□ 


□ 


□ 


d. 


'Do you feel that tiie board has sufficient authority or influence 
to see that the plan is implemented? 


□ 


□ 


□ 


□ 


e. 


I^o ynu feel that the objectives and plans are based on valid f nd 
realistic prnjeciions regarding the foreseeable future? 


n 


□ 


□ 


n 


f. 


U tliere provision for periodic review and updating of the 
plan to meet new needs? 


□ 


□ 


□ 


□ 


«• 


Do you feel that the planning process adequately involves 
all sectors, including the private and proprietary institutions? 


□ 


□ 


1 — 1 

LJ 


r"i 

u 


h. 


Does the plan provide an effective means to eliminate 
unnecessary duplications of proarams and services? 


□ 


□ 


□ 


□ 


1 , 


Are the objectives set forth in the plan and the methods of 
atfAlning thern consistent with available or realisticaliy 
projected fiscal resources? 


□ 


□ 


LJ 


r— 1 
LJ 


h 


Are there established procedures by which the board receives 
reports antj evaluates actions taken to implement the plan? 


□ 


□ 


□ 


□ 




Do you feel that the long-range (five years plus) and the 
inter mediate or short-range (one to three years) objectives 
of ifie plan have the understandinf^ of: 

(1) The public higher education institutions? 

(2) Ihe private higher education institutions? 


□ 

□ 


□ 

□ 


n 
□ 


□ 




(?) The proprietary institutions? 


□ 


□ 


□ 


□ 




(4) Ihe present membership of the board? 


□ 


□ 


□ 


[".] 




(5j Most ^tate fiscal and administrative officers? 


□ 


□ 


□ 


n 




(ft) Ihe general public? 


n 


□ 


□ 


□ 




(7) Other . . , _ = 




□ 


□ 


□ 



2. Do ynu teel that these groups are supporting these plans? Please circle the nurnhers utuirr question k 
vv/j/c/? indicate those who are supporting the plans. 



3. 



Comments on this topic; 
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Ifrdv^sity of Fissoi^i Task Force (1972) 

CRITERIA FOR EVMiUATiNG STRUCTURES FOR COORDINATING 
AND GOVERNANCE OF GTATE HIGH^t| EDUCATION 



General 



1. Program Control - Ability to establish sound p&ite^n o^ ^nstitucional missions j 
to dii tribute programs among institutions ir e^iucationally sound and 
efficient manner; and to diSGontinue old and establish new programs in a 
rational manner, 

2* RasQuroa Allocation and Use - Ability to define fiscal nttJ^^^ on a ccjrdiriatecl 
and responsible basis in ralation to specific instit -^.ional missions and 
overall staff needs* Includes consistency to budget fic-velopment and presen-- 
tation procedures, efficiency and effectiveness of pr.-^ .dures ? an^ control 
and evaluation of application of resources* 

3. Long-Ran^g Planning - toility to conduct cQntinuous and meanxngful lon^-range 

^planning fd]^higher education in the state for all post^secondary 
institutions and to inclement the rosuliiing plans* 

4. Assignment of Responsibility - Ability to identify responsibility and 

acnonntpbiliTy for conduct of higher euucation at institutional and state 
level. Includes appropriate differentiation between responsibilities 
for broad policy establishment and manage*^.@nt within policy guidelines* 

5^ Comprehensiveness of Purview = Degree to which structure foi coordination and 
governance permit s^"and encourages coordination among all segments of pos 
secondary education ^ including the private and community junior college 
Sfectors* 

influences 



6^ Institutional Autonomy and influen ce ^ Ability of institutions to maintain 
individual educational character , to eKercise appropriate control of own 
operations and approaches to assigned prograrns , and to bring institutional 
and educational considerations to boar in state^level decision ma-.Viig 
affecting higher education. 

^* kQZ_ ^^?J^6^^ntation - Degree to v/hich representavives of the lay public of the 
state participate in coordination and governance of higher education* 

8^ 5 tate_ rjoyernment Influence ^ Dtigree to which state government , executive and 
legislative r can influence development of higher education in concert with 
other programs of the state ^ while encouraging integrity and continuity of 
the higher education enterprise* 

Ad m i ni s t r a t i o n 

9* Span of Contro l - Degree to which coordinating and governing bodies and staff 
thereof are able to act on the basis of an adequate familiarity and under- 
standing of the individual operating units and institutions for which they 
are responsible. 

10. Cost s of Bureaucracy ^ Degree to which staff and other dollar costs of the 

structure for coordination and governance can be kept at ^ level consistont 
with the overall requirements of the activity* 

^' rece sses o f Bureaucracy ^ Ability of structure of coordination and governance 
to operate with the~mintmum necessary paper flew, review levels, and related 
attributes of bureaucratic processes* 

Xl* Responsiveness - Ability of institutions and of CQordinating structure to 
maintain the flexibility of operation required for timoly and efficient 
response to specific needs and requirements* 

3 Age ncy Staffing - Degree to which nature and responsibilities of coordinating 
or governing bodies permit the attraction of appropriately qualified staff. 
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IMvarsity of Missoi;ri Task Force (1972) 

POSTULATED AND OBSERVED CHARACTERISTICS OF THREE STRUCTURES 
FOR COORDINATION j^ND GOVERNANCE ACCORDING 
TO EVALUATIVE CRITERIA 



C riterion 

1, Program Control 

2, Resource Alln- 
Gation and Use 

3* Long-* Range 
Planning 

4, Assignment of 
Responsibility 

5* Comprehensive-' 
neas of Purview 

6. Institutional 
Autonomy and 
Influence 

7 , Lay Represent 
ta tion 

8* State Govern^ 
ment Influence 

9. Span of 
Control 

10, Costs of 

Dureaucraey 

Hi Processeo of 
Bureaucraay 

12 » Responsiveness 
13, Agency Khafflng 



Advisory 
Coordinating 
Agency 



Coordinating 
Agency With 
Regulatory 
Powers 



Consol idated 
Governing 
Board 







c 


>! S 




d 








>i C 


a 








>i a 








0 


H O 




O 






0 


H 0 


6 


-p 




o 


H 0 


O 


0 




»H 








o 






iH 'H 




' o 






H H 




s 




U 






M 






M 


iti M 


u 








fd M 








Q) 


'M m Q) 




0) 






(D 




m 0) 




dJ 






m 




4i 


+J 4J ^ 


+j 


+J 


m 




4J 


4J 4J +j 




m 


4J 


4J 


=M 4J 4J 




Q) 


m 


'H 


M (1) *H 


QJ 




m 




•H 


M (U H 


0) 


Q) 




<H 


M d) 'H 


OJ H 


0 




M 


m Q) u 


0) 


U 


Q 




M 


0) M 


0) M 


o 


0) 


u 


(tl (U M 


d) M 


Q 




U 


X U 


s 


u 


Q 




U 


^ Xu 


s u 


Q 


s 


U 


Oi U 


:^ u 



mil 



m////m/m 





'iiii iiiiniiiimmm m 



iimiiiiiuiiwunmTj, 



yiiinniiiiiliiiimrm 




m 



mnL 



mrmminiiiiix 



mmmmmim 



mim u 



mnuamm 





(iimiiLL 







iiiiiiifiiiiiiiimnii iiti 



WfllJ/JllJjWi status auggGSted from poatulatQa 

r32C3=S] status specified by conclusions from case studie s 



6' .9 



63 



APPENDIX G 

Five Major Roles And Related Tasks of a Consolidated Governing 
Board As Identified by the Academy for Educational 
Development / Governance of Public .Higher Education in Mlssiosippi (1979) 

1 . Governing Board of Individual Institutions 

As the governing board of individual institutions, the Board of 

Trustees has the responsibility to: 

--establish within the institutions a well defined decision 
making process that sets forth the roles of the president ^ 
the facu"^ ''^r senate (or similar group) , the student' senate 
(or sivdl>.jt' group), staff representatives, and students; 

^-appropriately classify governance decisions as academic 
affairs, faculty affairs, student affairs, non=faculty 
personnel affairs, or administrative and financial affairs; 

-.-develop, above the level of the institution, a grievance 
procedure for fact-finding and reconmendation; 

--clearly differentiate between governance and management 
and between work planning and work performance; 

--delegate managerial autonomy to the institutions' 
administrations ; 

--develop and maintain a comprehensive management information 
system that provides planning and evaluative information; and, 

--periodically evaluate management and governance performance. 

2 . Statewide Planning 

As the entity responsible for state-wide higher education planning, 

the Board of Trustees should, at least for the state universities: 

--periodically determine the State's higher education needs in 
instruction, public service, and research by considering 
geographic access, student costs, and State development patterns; 

--consider the role of private institutions, junior colleges, 
and accredited postsecondary proprietary schools in meeting 
state-wide needs; 

--develop differentiated missions or roles for the universities 
that consider; 
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. standards or quality; 

admissions standards; 
. instructional progtams; 
. public service programs; 
. research programs; 
. enrollment size; and, 
, special expectations ; 

provide for broad-based comnunity, faculty, and student 
inputs into the planning process; 

periodically publish a master plan that indicates the 
aspirations and strengths of the system, areas that should \ 
be improved, strategies that should be improved^ and anticipated 
financial requirements of the system: and^ 

develop a process that relates the master plan and 
institutional mission to facility requirements. 

Statewide Coordination 



The Board of Trustees should^ 

maintain a current and comprehensive Inventory of the 
programs the institutions offer and of correlated indicators 
of program productivity; 

use a well-defined process of periodic program review and 
evaluation; 

develop and maintain an intelligible budgetary process that 
provides for the equitable allocation of state-appropriated 
general fund revenues according to statewide plans, institutional 
missions, enrollment patterns^ and special institutional needs; 

maintain for all institutions a well-defined and flexible 
personnel and classification plan that can be adjusted for 
varied missions and programs; 

develop and Implement an equitable, mission-related plan 'for 
physical facilities expansion or r^^novatlon; andj 

develop and maintain a comprehensive, accurate, and up-to- 
date information system that provides useful Information to the 
institutions and, for policy decisions, to the Board 
and the Legislature, 
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Insulation from Political Iriterference 
In fulfilling this aspect of Its role, the Board should- 

-provide evidence of Its comiitment to protecting ' 
academic freedom^ 

-support the managerial autonomy of the Instltucions ; and, 

-coranlt Itself to a philosophy of political accountability 
without political subservience, 

Public Advocacy 

The Board needs i 

-an effective program of public Information; 

-the reasonable cooperation of the executive branch 
of the State Government; 

the reasonable cooperation of the legislative 
branch of the State Government; and, 

the intetested and informed opinions of groups on 
the performance^ needs, and future of higher 
education In Mississippi. 
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Six Essential Characteristics to be Sought in 
State Governinent Organizational Arrangements from the 
A.E.D. Discussion faper #2 prepared for Florida, (197^1 

The state government organization for higher education should 
be comprehensive in scope, including two-year programs in 
technical education, two-year college transfer programs, 
baccalaureate programs, graduate programs, and first professional 
programs , 

The estate government organization for higher education should 
be concerned with, the welfare of private as well as of public 
higher education institutions in the state. 

The state government organization for higher education should be 
oriented toward the concerns of state government with the needs 
for higher education services, access to higher education, the 
fullest possible utilization of all available resources for higher 
education service, the delivery of services of appropriate 
quality, the elimination of duplicating programs of high cost 
and limited enrollment, the effective performance of higher 
education serices, and the efficient performance of higher educatic 
services. 

In order to fulfill its role of giving attention to the state 
concerns with higher education services, the state organization 
should not be vested with the authority and responsibility of 
campus governance. 

The state organization for higher education should be provided 
with the requisite authority and rRsponslbility to prepare 
periodically a state master plan, to coordinate program offerings, 
CO undertake analytical studies, and to develop standards of 
appropriation support for the current operations and the capital 
plant requirements of higher education Institutions in the state 
for consideration of the Governor and the state Legislature. 

The ntate organization for higher education should be supported 
by rhe elected officials of state government without demanding 
or expecting the state organization to be politically subservient 
to elected officials. 
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APPENDIX I 

Respondents to Informational P.Gquest on South Carolina Criteria 
Relative to Its Appropriateness and Utility as a Model for Review 

of State Boards in Other States 



Anon3rmous 

Arceneaux, William 
Conimissioner of Higher Education 
Board of Regents 
State of Louisiana 

Bailey, Stephen K, 
Professor of Education and Social 
Policy 

Graduate School of Education 
Harvard University 

Bjork, Richard E. 
Chancellor 

Vermont State Colleges 

Bowen, Richard L. 

Coiraniss loner of Higher Education 

Board of Regents 

State of South Dakota 

Cole, Patricia 
South Carolina Legislature 
Audit Conmiittee 
Columbia, South Carolina 

Cook, M. Olin 
Director 

Department of Higher Education 
Little Rock, Arkansas 

Cooper, John M. 

Columbia, South Carolina ^ 

Dunlap, E, T. 
Chancellor 

Oklahoma State Regents for 
Higher Education 

Erbschlos, R. R, 
Executive Director 
Arizona Coimnission for 
Postsecondary Education 



Friday, William 
President 

University of North Carolina 

Fuller, William S. 
Executive Director 
Nebraska Coordinating Commission 
for Postsecondary Education 

Furlong, Thomas E., Jr. 
Associate for Program Policy 

Analysis 
Department of Education 
State of Florida 

Godwin, Winfred L. 
President 

Southern P^eglonal Education Board 

Hollander, T. Edward 

Chancellor 

State of New Jersey 

Huff, Robert A, 

Executive Secretary 

Board of Educational Finance 

Commission on Postsecondary Educ* 

State of New Mexico 

Hughes, John F. 
Director 

American Council on Education 

Huxol, Robert L* 

Associate Superintendent for 

Postsecondary Education 
Department of Education 
State of Michigan 

Kerr, Clark 

Carnegie Council on Policy Studies 
in Higher Education 
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Kerschner,' Lee R. , 
Executlva Director 
Colorado Comnlssion on Higher 
Education 

Kirkwood, Robert 

Executive Director 

Coiraniasion on Higher ^Mucation 

Philadelphia 

Knight, Jonathan 
American Association of 
University Professors 
Washington j D.C. 

Martorana, S. V. 

Professor of Higher Educatioa 

and Research Associate 
Pemisylvania State University 

McCarthy, Patrick E, 
Chancellor 

University; of Maine 

Miller, James L., Jr, 
Professor of Higher Edueatlbn 
Center for the Study of Higher 

Education 
University of Michigan 

Mlllett, John D^ 
Executive Vice President 
Academy for Educational 
Developinent 

Morton, Ben 
Chancellor 

West Virginia Board of Regents 

Norris, C, Gall 
Executive Coordinator 
Council for Postsecondary Ed 
State of Washington 

Olson, T, 

Executive Director 
Oregon Educational Coordinating 
CoOTiission 



Orwlgi Melvind D, 
Associate Director 
National Center for Higher 
Education Management Systems 

Peterson^ Marvin W, 
Director 

Center for Study of Higher Education 
University of Michigan 

Pounds^ Haskln R. 

Vice Chancellor for Planning 

Board of Regents 

University System of Georgia 

Romesburg, Kerry D, , 
Executive Director ^ 
Alaska Commission on Postsecondary 
Education 

Schmidtlelu, Frank 
Maryland State Council for 
Higher Education 

Sirotkln, Phillip 
Executive Director 
WICHE 

Snyder, Harry M. 
Executive Director 
Council on Higher .Education 
Comnonwealth of Kentucky 

Usdan, Michael D, 
Commissioner 

Board of Higher Education 
State of Connecticut 

Young, Edwin 
President 

The University of Wisconsin System 

Young, Kenneth E, 
President 

Council on Postsecondary Accveditatlon 
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